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The    timing   of   traffic   signals    is    one    of  the   major  prob- 
lems    in    traffic   engineering  practice.      While    several    theories 
have  been    developed    for   the    control    of   undersaturated   inter- 
sections,   little    theoretical   work  has    been   performed   for 
oversaturated    conditions.      The    objective    of   this    research    is 
to    develop    the    theory    for   the    optimal    signal    settings    of   over 
saturated   intersections.      The    mathematical    analysis    Is    based 
state-of-the-art    of   optimal    control    theory.      The    folio-. 


ing   problems    are    treated   assuming  nonlinear   time    varying 
demands:       (1)    minimization    of   total    delay    of   isolated   over- 
saturated    intersections,     (2)    minimization   of   total    delay    sub 
ject    to    queue    length    constraints,     (3)    optimum   cycle    length 
determination,     (4)    bus    priorities    at    oversaturated   intersec- 
tions,    (S)    minimization    of   the    total    delay    of   two    consecutiv; 


oversaturated   Intersections   with    and  without 
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constraints,  including  the  effects  of  turning  volumes  and 


travel  time  between  th 


e  intersections,  ana  (.5  J  optimal 


control  of  a  system  of  more  than  two  overs aturated  Inter- 
sections In  succession. 

Numerical  examples  are  presented  to,  demonstrate  the 
effectiveness  of  the  theory  under  different  formulations. 
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CHAPTER   1 
INTRODUCTION 

i  .  1 .      Statement    of   the   Problem 

The   problems    associated  with   vehicular   traffic  moving 
through    a   city  network   of   streets    are   numerous.      The    intro- 
duction   of   freeways   has    changed   the   patterns    of   traffic    and 
has    somewhat    relieved   congestion    on   surface    streets;   but   the 
signalized   intersection    continues    to  be    a  major  problem. 

The    traffic   demand   at    signalized   intersections    varies 
throughout    the    day    and    congestion    frequently    occurs    during 
the   morning    and   afternoon   peak  periods    due    to   the    large 
numbers    of  people    driving   to    or    from  work. 

During    the    periods    of    congestion,    the    demand   exceeds    the 
capacity    of   the    intersection,    causing   queuing   conditions    to 
develop.       These    conditions    continue    until,    at    some    point    in 
time,    demand  has    decreased   to    a   level   below    capacity   such 
that    the    queues    are    dissolved.       When    these    conditions    develop 
the    intersection    is    called   overs aturated   or    congested. 

Congestion    at    signalized   intersections    can   be    prevented 
either   by   building   new    transportation    facilities    or  by 
increasing    the    capacity    of   the    intersection.       However,    con- 
struction   of  new    facilities    is   not    always    feasible    in    urban 
areas,   where    congestion    problems    are   most    severe,    nor    does    it 


necessarily  result  in  complete  elimination  of  the  problem. 
The  intersection  capacity  can  be  increased  by  proper  chan- 
nelization, peak  period  parking  restrictions,  prohibition  of 
certain  movements  during  the  peak  hours,  installation  of 
traffic  control  devices,  and  ether  conventional  traffic  con- 
trol measures.   Nonetheless,  these  measures  have  certain  limi- 
tations, and  congestion  at  most  signalized  intersections  dur- 
ing the  peak  periods  is  unavoidable.   The  duration  of  the 
congested  period  is  a  function  of  the  demand  at  the  inter- 
section as  'well  as  its  capacity. 

Congestion  can  further  be  relieved  by  proper  control  of 
the  traffic  signals.   The  timing  of  traffic  signals  is  one 
of  the  major  problems  in  traffic  engineering  practice.   While 
several  theories  have  been  developed  (and  applied  success- 
fully) for  the  control  of  undersaturated  intersections,  little 
theoretical  work  has  been  performed  for  overs aturated  condi- 
tions.  At  this   time,  only  one  theory  has  been  developed  for 
pre timed  (open  loop)  control  of  overs aturated  traffic  signals. 
However,  due  to  its  limitations  and  some  oversimplified  assump- 
tions, this  theory  cannot  be  applied  in  practice.   For  real- 
time (feedback)  control,  few  theories  have  been  developed; 
but  it  should  be  noted  that  none  have  been  applied  in  a  real 
system,  partly  because  of  the  extensive  instrumentation  and 
computational  requirements  and  partly  because  traffic  engi- 
neers tend  to  avoid  extensive  departure  from  conventional 
methods.   Furthermore,  some  theories  are  based  on  assumptions 
which  are  unrealistic.   For  those  reasons,  the  methods 


presently   used  by    traffic   engineers    are    dependent    on   prac- 
tical   considerations.       There    is    clearly    a  need   for    a   realis- 
tic  theory   to   solve   the   problem   of   control    of  overs at urate d 
inte  rsections . 


1.2.      Scope    of   the    Study 

Development    of   a   theory    for    optimal    signal    control    of 
overs aturated  intersections    is    the    objective    of   this    disser- 
tation.      The    mathematical    analysis    is   based   on    the    current 
state    of   development    of   optimal    control    theory.      The   problems 
that   have   been   studied   are    formulated   and  solved   as    optimal 
control   problems.      Unlike   previous    theories,    the    assumptions 
and   proposed   solutions    reflect    real-world   situations    so    that 
the    results    are    directly    applicable    in  practice.      The    follow- 
ing problems   have   been   studied. 

1 .  Optimal    control    of   an    isolated   oversaturate d  inter- 
section with,  lower  bound  constraints   on  the  queue   lengths . 

The    only    objective    of   the    control    is    minimization    of   the    total 
de  1  ay . 

2 .  Optimal    control   with    upper   and   lower  bounds   placed 
on    the    queue    lengths.       Minimization    of   the    total    delay    is    the 
objective    of   the    control,    but    the    queues    are   not    allowed   to 
exceed    a   predetermined   upper    limit    (to   prevent   blocking   up- 
stream  intersections).       in    this    case,    the    resulting    delay    is 
higher    and    the    control   becomes    complex, 

3.  Bus  priorities  at  overs aturated  intersections .  Mini- 
mization of  the  total  passenger  delay  is  the  objective  of  this 
control. . 


4 


Optimal  control  of  a  system  of  two  overs aturated 


intersections  in  succession.   This  problem  is  not  a  simple 
extension  of-  the  problems  listed  previously.   The  number  of 
control  variables,  turning  volumes,  and  time  delays  of  the 
control  that  are  introduced  enlarge  the  problem  considerably. 
That  is,  the  control  action  at  the  downstream  intersection  at 
time  t  is  a  function  of  the  control  action  taken  at  the  up- 
stream intersection  at  time  t-d  where  d  is  the  travel  time 
between  the  two  intersections,   Minimization  of  total  "system" 
delay  is  the  objective  of  the  control  with  lower  bounds  and 
upper  bounds  on  queue  lengths. 

5-   Optimal  control  of  a  system  of  more  than  two  over- 
s aturated  intersections.   The  theory  of  item  4  is  extended  to 
include  more  than  two  oversaturated  intersections  in  succes- 
sion. 

Num.eric.al  examples  are  given  to  demonstrate  the  applica- 
bility and  the  effectiveness  of  the  theory  under  different 
formulations.   It  should  be  emphasized  that  in  the  development 
of  the  theory,  demands  are  assumed  to  be  time  varying  as  in 
reality.   Furthermore,  no  particular  assumptions  are  made 
concerning  the  patterns  of  the  demands.   The  theory  is  also 
applicable  for  initial  and  final  states  other  than  zero  and 
for  cases  in  which  the  control  period  is  prescribed. 

1 .  3 .   ^Kf11!!  z  at  ion 

The    existing    theories    are    discussed   in    Chapter    2.       Chap- 
ter   3   introduces    the    fundamental    principles    of   optimal    control 


theory  which  constitute  the  basis  of  the  mathematical  analyse 
that  are  performed  in  subsequent  chapters.   The  solutions  of 
the  problems  associated  with  a  single  intersection  are  devel- 
oped in  Chapter  4.   In  Chapter  5,  a  control  scheme  for  bus 
priorities  is  developed.   Chapter  6  includes  the  solution  of 
the  problems  associated  with  a  system,  of  two  overs  aturated 
intersections  ;  and  the  theory  is  extended  for  more  than  two 
intersections  in  Chapter  7.   A  summary  of  major  findings  and 
suggestions  for  future  research  are  given  in  Chapter  8. 
Finally,  several  numerical  examples  are  given  in  Appendix  A. 


CHAPTER    2 
LITERATURE    REVIEW 


2.1.      Preface 


Although    the    problem   of    optimizing    the    operation    of    over- 
saturated   intersections    is   not  new,    little    theoretical  work 
for   its    solution   has   been  performed.      For  pretimed  traffic 
control    the    only    theory    thus    far   developed   is    that    of   Gazis 
and    Potts,      whereas    for   real-time    control    the   most  widely 
known   works    are    those    of  Miller/'0    Ross    et    al .  ,  '    and   Longley,' 
The    methods    presently    used  by   most    traffic    analysts    are    empiri 
cal    in    form   since    the    theories    that   have   been    developed    for 

unders aturated   intersections    are    not    valid   for    overs aturated 

1 

ones,    and  the    theory    of   Gazis    and  Potts"    contains    certain 

unrealistic   assumptions    that   make    its    use-  questionable    for 
real-world   situations.       In    addition,    the    algorithms    developed 
by   Ross    e_t   al .  ,      Longley,      and   Lee      are    semi -empirical,    and 
as    such    they    do  not    constitute    true    optimal    control   policies. 
Therefore,    testing    of    these    models    requires    use    of   simulation 
techniques.       It   should  be    emphasized   that    up    to  now,    none    of 
the    theories    developed  has    been    applied   in    a    real    system. 

What    is    needed,    then,    is    a    theoretical    formulation    that 
does    not    rely    on    simulation,    but    actually    shows    why    and  how 
to    optimally    control    overs aturated  signalized  intersections. 


Before    describing    a    realistic    optimal    control   procedure,    a 
discussion    of   existing    theories    is    in    order. 

2,2.      The   Existing  Theories 


Gazis    and  Potts"     consider   an    intersection   serving   two 
competing   demands    associated  with   time    varying    arrival   rates 
q-j  (t)    and  q_2  (t)  .      A  sufficient    condition    for   overs  at  urat  ion 
is    given  by 

ql/sl    +    q2/s2    >    1    "     (L/c^  (2.2.1) 

where    q1?q?    =  the    arrival    rates    (vehicles    per  unit    of   time) 

s]_js2    =  the    saturation    flows     (vehicles    per   unit    of    time) 
c   =  the    cycle    length    (seconds) 
L   =  the    total    lost    time    per   cycle    (seconds). 
Assuming   that  at   the   beginning    of   ove rs aturation   period 
there    are   no   queues    on   either   of   the    two    approaches,    the    cumu- 
lative   demand  functions    are    given   by 

Ti 
Q-i  (t)    =    J      q^  (t)dt  i    =    1,2  (2.2.2) 

o 

where    the    time    origin    (zero)    is    the    onset    of   overs aturation 

and  T      is    the    final   time    at   which    the    queues    are    dissipated. 

The    LLiaewj.se    variation    of   cumulative    service    volume    for   a 

given    approach   is    characterized  by    a   saw-toothed  pattern    such 

as    that    shown    in    Figure    2.1.      Assuming    that    this    saw- toothed 

pattern,    caused   by    the    intermittent    serving    of   traffic   by    the 

light,    caa   be    represented  by    a    straight    line,    the    cumulative 

service    functions    G, (t)    are    given   by 


Figure    2 . 1 


G.(t)    -    /      Yi(t)dt 

o 


1,2 


(2.2.3) 


where   y-    is    the   service    rate    of   approach   i. 
is    defined   as 


ihe    service    rate 


Yx(t) 


gi(t) 


i    =    1,2 


(2.2.4) 


where  g-  is  the  effective  green  time  that  is  given  to 
approach  i. 


If  the  saturation  flows  s,  and  s_  of  the  conflicting 
streams  arc  equal,  the  aggregate  delays  are  minimized  when 
both  queues  are  dissolved  simultaneously,  and  this  is  accom- 
plished by  a  single  setting  of  the  light,  so  that  the  follow 
ing  relationships  are  satisfied: 


QiCT)     -    -^i-  =0  i   *    1,2  '  (2.2.5) 

S1    +    g2    +    L   a    c  ,  (2.2.6) 

where   T    is    the    final   time    at  which   the   queues    are    dissolved. 

In   the   more    general    case,   however,   where    saturation 
flows    are    unequal,    i.e.,    s,    >    s-,    the  'single    setting   strategy 
is    not    the    only    one    that    dissolves    both  queues    simultaneously, 
nor   does    it    constitute    the    control   that   minimizes    the    aggre- 
gate   delay.       In   this    case,    the    aggregate    delay   can  be    reduced 
by   trading   off   some    delay    for   the   major   stream,    i.e.,    the    one 
associated  with    the   maximum  saturation    flow    (s,)    for   smaller 
amounts    of   delay    of   the    other   stream.      This    is    accomplished 
by    setting   upper    and    lower  bounds    on    the    green    times    for   each 
phase.       The    optimal   strategy  which    simultaneously    dissolves 
both   queues    at   the    earliest   possible    time    corresponds    in 
general    to    a   two-stage    operation.       During    the    first    stage 
the    direction    associated  with    the    highest    saturation    flow 
receives    maximum   green    time    (the    second   approach    consequently 
receives    minimum   green).       In    the    second   stage    the    service 
rates    are    reversed,    i.e.,    minimum   green   time    is    given   to   the 
first    direction    and  maximum  to   the    second.      The    switching    from 
one    extreme    of   the    control   variable    (in    this    case    green   time) 
to    another   is    generally    referred   to    as    "bang-bang    control"    In 
control    theory. 

Under    the    assumptions    that   no    constraints    are   placed   on 
the    queue    lengths,    that    the    input    curves    are   explicit    func- 
tions   o £    time j    and    considering   two    streams    only,    the 
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switchover  point    and   the    earliest    end    of   ova rs aturation    period 
can   be    found.       By    approximating   the    input    curves    fay    linear 
functions    of   time    of    the    form 

Qi(t)    =   A.    +    B.t  (2.2.7) 

the    switchover  point    and   the    final    time    are    determined  by    the 
relationships 

A,  s    +A9s 

T.1       L            L        JL 
(2.2.8) 

(BlS2  +  B2Sr  +  Sls2(1"ci) 


t    =     [(c/s.) -Q. (T)-g    .    T](g         -g    .    )_1  f 2 . 2    9^ 


-  -X 


here    gmnv,g_,z_,    are    the    upper   and   lower  bounds    of   the    effec- 
tive    green   time    of  the    first    approach,    and   T    is    the    switchover 
time.      The    above    formulas    allow   negative    queue    lengths,    and 
must    therefore   be    used  with    caution. 

Gazis    and  Potts      also   made    an    unsuccessful    attempt    to 
find    the    optimum   cycle    length,    assuming   linear   demand   curves 
as   before.      Even  with    the    oversimplified   demand    function,    the 
complexity    of   the   problem  was    such   that   to   obtain    a   solution, 
B.,     and   B?    had    to   be    assumed  equal    to    zero,    i.e.,    no    input 


it. 


a 1 1 e r  time  ze r o . 

7 

Green'  also  attempted  to  find  the  optimum  cycle  length 
assuming  linear  demand  curves  and  also  that 


Ai  =  A2  ;=  A  (2.2  .10) 

B}  ^  B,  -  B   and  (2.2.11) 

S  ,  -     S „  ~  S  (? 


12) 


11 

These    assumptions    are   better   than    the   previous    ones    but   they 
are    again    unrealistic.       Making    the    above    assumptions    and    con- 
sidering   two    approaches,    Green    derived    the    following   expres- 
sion   for    optimum   cycle    length 

sL  2r?R  i  /-, 

Copt    =    ^TB    +    i^TI"    [BL    (s-f-3    +    ALCS-2B)]1/2  (2.2.13J 

q 

Gazis       also    considered    a   pair   of   intersections    of   three 
one-way   streets    such    as    shown    in    Figure    2.2    and   assumed   that 
the    transit   time    and  queueing   storage   between   intersections 
are   negligible    and  that   the    intersections   become    oversaturated 
at    approximately    the    same    time.       These    assumptions,    of   course, 
oversimplify    the   problem  because    the    two    intersections    are 
treated   as    one    and  thus    the   problem   is    the    same    as    that    for 
the    single    intersection.      With    these    rather   unrealistic 
assumptions,    Gazis    gives    a   similar  policy    improvement    scheme 
as    that    for    the    single    intersection.      Unlike    the    single    inter- 
section   case,    the    problem   is    not    formulated    as    an    optimal    con- 
trol  problem.      As   will  be    shown   in   Chapter   6,    the    solution   of    ■ 
this    problem   is    not    an    easy    one    since    there    are    two    control 
variables,    and  time    delay    of   the    control    is    introduced. 

It   should  be    emphasized   that,    although    the   work    of   Gazis 
is    a  major  breakthrough    in    this    area,    it   has    some    inherent 
disadvantages   which   make    it    difficult    to    apply   direct!' 
real-world   situation.      The   major   disadvantage    of   the    theory 
is    that   no    constraints    are   placed   on    the   queue    lengths.      Wh< 
an    intersection    is    oversaturated    the    problem    is    not    only    to 
minimize    the    aggregate    delays    of   the    conflicting   strrw 


:o    a 


I 
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«^1 


Figure    2 . 2 


q, 
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but    also    to    restrict    the    queues    so    that    they    do   not   block 
upstream   intersections , 

A   second   disadvantage    is    that    in    a    real-world   situation 
the    cumulative    demand   curves    are   nonlinear.       For   the   pair   of 
intersections    the  basic    assumptions    are    clearly  unrealistic 
and  thus    the   problem   is   not    actually   solved.       Similarly,    the 
assumptions    for   computation    of   the   optimal    cycle    length    are 
unrealistic . 

The   work   of  Miller    '      and  Ross    et    al_.      is    discussed  next, 
but    it    is    emphasized   that    this    theory   as   well    as    the    subse- 
quent   ones    applies    for   real-time    control   systems    only.      Miller 
considers    a    four-way    intersection  with   heavy    traffic    on    the 
two    arms    1    and   2,    and    assumes    that    at    time    t    the    signal    is 
green   on    approach    1.      At    this    time    the    controller   can  make    a 
binary    decision,    i.e.,    to    change    the    signals    Immediately 
(alternative   A) ,    or    alter    an    extension    of   one    unit   of  time 
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(alternative   B) .      Assuming   that    an   extension   of  the   present 
phase   will    simply    displace    all    future    changes   by   the    same 
amount    of   time,    the    differences    in    delays    can  be    approximated, 
The    difference    in    total    delay    caused  by    choosing    alternative 
A   over    alternative    B    is    the    sum   of    the    three    terms 


+  5i  .\  ^+v 
j=i     j 

*1        ±        i 


(2.2.14) 

(2.2.15) 
(2.2.16) 


where  6,  =  the  number  of  extra  vehicles  which  would 
pass  through  the  junction  if  the  current 
phase  were  extended  by  one  time  unit; 

k  =  the  number  of  cycles  required  to  exhaust 
b  o  th  q  ue  ue  s  ; 

r\.  =  the  duration  of  the  jL"  red  on  arm  1; 

£-.  =  the  time  lost  in  acceleration  on  arm  1; 

S-,  =  the  average  saturation  flow  on  arm  1;  and 

N, ,N«  =  the  number  of  vehicles  on  arms  1  and  2, 

respectively,  which  will  pass  through  the 
junction  before  both  queues  have  been 
exhausted. 

A  test  function  T  is  then  defined  which  is  equal  to  the 

sum  of  the  three  terms  listed  above.   If  T  is  positive,  the 

extension  should  be  granted.   If  T  is  negative,  extension  is 

not  granted.   Similar  considerations  apply  for  extension  of 

the  green  time  for  two,  three  or  more  extensions  before  endin* 

the  curren  t   plias  e  . 
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Miller"'""    did  not    consider   the    interactions    of   adjacent 
intersections,    and  thus    did  not    include    the    downstream   delays 
in    determining   an    optimum  extension   strategy.      Weinberg   et    al.9 
pursued  Miller's   model    further  by   including   downstream   delays 
and   deriving   equations    for   the   prediction    of    total   delay    as 
a   function    of   the   extension   period.      Weinberg   et    al.    also 

extended   the    theory    for  more    than    two   phases. 

4 
Ross    et   al. ,      basing   their  work    on    a  philosophy   similar 

to    that    of  Miller    and  Weinberg,    developed    a   computer    control 
scheme    for   traffic,   responsive    control   of   a   critical   intersec- 
tion  that  not    only   minimizes    the    total    delay    of   all   users    of 
the    intersection,   but    also   minimizes    the    total    delay    accumu- 
lated  at    downstream   intersections.      This   was    accomplished  by 
further   simplifying  Weinberg's   model.      According    to   this 
scheme,    the    cycle    length    of   the    critical    intersection    is 
allowed   to   vary  between    a  maximum   and   a  minimum  value;    however, 
the    cycle    lengths    of    the    adjacent    intersections   were    assumed 
constant.       The    turning   movements   were    ignored   and   the    effect 
of   downstream    residual    queues    upon    total    delay  were    assumed 
negligible.      The   new   scheme   was    compared  with   that    of   fixed 
time    control   by   means    of   simulation    and  was    found  beneficial. 

There    are    certain    disadvantages    associated  with    the    above 
theories.      The    first   is    that  when   the    intersection    is    over- 
saturated,    a   single    extension    of    a  phase    does    not    simply    dis- 
place   ail    future    signal    changes    by    one    unit    of    time    as    was 
basically    assumed   by   Miller2,0    and   others    using    the    same    con- 
cept.     This   may  be    approximately    true    for   undersaturated 
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conditions    for  which   Miller's   model    also   applies,    but    for 
overs  at  ur  ate  d  conditions    this    assumption    is    questionable- 
since    the    queues    are    not    exhausted   in    the    "next    cycle"    if    the 
previous    cycle    is    extended  by   n • At    units    of    time. 

The    other   major    disadvantage    is    that    in    order   to    apply 
these    models,    predictions    of   several   variables    are   necessary. 
These   predictions    reduce    the    accuracy  "of   the    estimation    of 
the    intersection    "gain"    T. 

Another   disadvantage    is    that    the   effects    of   downstream 
residual   queues    upon    total    delay    are   not  negligible    as   was 
assumed  by   Ross    e_t    al.  ,      but   should  be    taken   into    account 
when   system  delay   is    considered. 

in    addition,    no    theory  was    developed   for    a   system   of 

overs aturated  intersections . 

1 0 
According   to    Gazis,       'the    above    schemes    could  probably 

be    improved  by    application    of   the    familiar   techniques    of 
adaptive    control   suggested  by   Kwakernaak  [11]  for    a   single    inter- 
section,   namely,    predicting    for   the    next    five    periods    and 
applying   the   best   strategy    for   one   period  only."      None    of 
these    schemes    has    been    tested   as    yet    in    a   real    system,    partly 
because    of   the    relatively   extensive    instrumentation    and   com- 
putation   requirements,    and  partly   because    traffic   engineers 
tend    to    avoid   extensive    departure    from    conventional    systems. 

Minimization   of   total   delay  was    the    objective    of  the    con- 
trol   theories    discussed   thus    far.       Attention    is    now    given    to 
theories    where    emphasis    is    given    to   queue    lengths    rather    than 
to    aggregate    delays. 
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A   control    scheme    for    a   two-phase    congested    intersect! 


on 


employing    a   "queue   balancing"    strategy  was    proposed  by    Long- 
ley.         This    strategy   seeks    to  hold   a  particular   linear   func- 
tion   of    the    intersection    queues    to    a   value    of    zero   by    adjust- 
ment   of   the    green    time    split.       This    linear    function    is    termed 

p 

the    "queue    unbalance"    (Q.)    and  may   be    defined    as 


Qi    =    <*il    +    ^13    "    Bi2Qi2         Bi4Qx4 


(2,2.17) 


where    i    denotes    a  particular   intersection    and   j    =    1,2,3,4   is 
a  particular    approach.       The    queues     (Q.  .)    are   measured   at    the 
end   of   the    appropriate    green   period,    and   the    B.  .    terms    are 
weighting    factors    indicating   the    relative    undesir ability   of 
the    queue    on    the    appropriate    arm;    the    green    time    split    is 
adjusted   in    the   succeeding    cycle    so    as    to   reduce    the    queue 
i nib  a  1  an ce    to    zero. 

If   the    total    traffic    flow   to    the    junction    is    high,   but 
below    saturation    level,    this    strategy   will    ensure    that    ail 
queues   with   nonzero  weighting    factors    will    gradually    disperse 
and   the    green    times   will   be    proportional    to   the    total   traffic 
flows    on    opposing    arms.       If   the    traffic   flow   exceeds    the    satu- 
ration   level,    the    queues   will   inevitably   increase,   but   the 
desired  balance   will   be    maintained    and    the    green   split   will 
again    depend  upon    the    traffic    flow,      This,    of   course,    does 
not   necessarily   mean    that    the    queues    will    remain   below    some 
predetermined   upper   limits.      The    control    action    is    achieved 
by   varying    the    green    time    for    arms    1-3   which   move    simultane- 
ously   in    accordance    with    the    relationship 
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g,Ci)    -   A.  Q.Cn-lj    +    Bj_      £        Qf  (in)  (2. 2.  IS) 

ni=0 


where    gi (n)    is    the    value    of   green    time    for    arms    1-3    on    inter- 
section   i    in   excess    of   its    equal   split   value    during   the   nth 
traffic    light    cycle.       The    parameters    A.     and   B.    are    called   the 
proportional    and   integral    controller   gains,    respectively,    and 
their  values    must  be   selected    (empirically)    with    care    to 
ensure    a   satisfactory  behavior   of   the   signal. 

According   to    Longley,      the    proportional    controller    simply 
increases    the    green   time    for   arms    1-3  whenever   the    queue 
balance    is    positive    and   vice    versa.       The    integral    controller 
seeks    to    ensure    that    no    steady-state    queue    unbalance    exists 
when   the    total   traffic    flows    on   opposing    arms    are    themselves 
unb  alanced. 

The    difficulty  here    lies    in   the   selection   of   the   param- 
eters   A1    and  Bi   which   must   be    determined  empirically    and   also 
in    the    definition    of  the    queue  which,    due    to   the    various    com- 
putational   difficulties,    is    relaxed   to    include    all   the    traffic 
within    a   certain    distance    of  the    intersection.       In    addition, 
the    queues    are   not   measured   constantly   but    only    after   the 
end   of    the    green   period.       This    makes    the    method   inflexible, 
considering   the    fact    that   it   is    designed   for   real-time    con- 
trol.      Thus,    the    decision    is    made    for   the   next    cycle    rather 
than    for    the    present    cycle    as    it    is    done   with    the    real-time 
control    methods    mentioned   previously. 

For   the    system   of   intersections,    Longley5   considers    a 
perfectly    symmetric  network  with   equal    input    flows    on    all 
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arms,    and    an    Input    flow    rate    exactly   balanced  by    an    output, 
flow    rate    on    each    arm.       In    addition,    he    assumed   that    equal 
queues --at    the    end   of    the    appropriate    green   pe  riods  - -exist 
on    ail    arms    and  the   queue    unbalance    is    therefore    zero.      Using 
these    obviously    unrealistic    assumptions,    Longley    derives    the 
f o  1 1 ow ing    f o rmul as : 

B  B  n"2         r 

QiCn)    =    -Qi(n-1)     -       I         Q?(X)    +    cA  (2.2.19) 

m=0 
g.    =   |_   [Q^Cn-1)    +    I     Z      Q*(m)J  (2.2.20) 

If   g-L    >    gm#    gj_    is    recomputed  by 

gi    =    '"Si  Cgi^gm  (2.2.21) 

where  g   is  the  modulus  of  the  maximum  permitted  green  time 
deviation,  c  is  the  cycle  length  (which  is  assumed  constant), 
A  is  the  difference  of  the  input  flows  between  the  two  pairs 
of  arms,  and  S.  Is  given  by 


c 


i  =  Sil  +  BI2Si2  +  Bi3Si3  +  Bi4Si4  (2.2.22) 


Again,  turning  volumes  are  Ignored  as  with  the  single  inter- 
se  ction . 

T  6 

Lee    ?:f..  f~±.«       also    considered  queues    rather   than    delays 
as    the    objective    of   the    control    and   developed   another   semi- 
empirical    strategy    called   "Queue    Actuated   Signal    Control." 
This    is    a    control    policy   where    an    approach    receives    green 
automatically   when    the    queue    on    that    approach   becomes    equal 
to    or    greater   than    some    predetermined   length,    regardless    of 
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the  conditions  on  the  conflicting  approaches.   The  policy- 
assumes  that  no  two  conflicting  approaches  reach  the  upper 
bound  specified  for  them  simultaneously. 

The  assumption  that  the  queue  lengths  will  not  reach 
their  upper  bound  simultaneously-  implies  light  overs  aturation , 
but  even  in  this  case  this  possibility  should  not  be  excluded. 
This  situation  will  certainly  arise  in  case  of  heavy  over- 
saturation  and  it  is  therefore  necessary  to  establish  a  maxi- 
mum and  minimum  cycle  length,  as  well  as  a  maximum  green  time. 
This  control  policy  is  based  on  the  concept  that  when  queues 
on  approach  A  grow  to  a  critical  length,  approach  A  should 
get  a  green  phase  and  keep  it  until  the  same  condition  arises 
on  approach  B.   The  placement  of  the  detectors  required  for 

this  type  of  operation  must  be  determined  empirically.   Pig- 

1? 
nataro  et  al.    point  out  that  this  control  policy  disrupts 

signal  coordination  when  the  intersection  is  located  in  the 

midst  of  an  area  of  coordinated  signals.   In  addition,  for 

heavy  overs aturation  the  cycle  length  becomes  short  and  this 

general!}-  increases  total  delays. 

Making  the  assumption  that  the  arrival  rates  are  Poisson 

and  assuming  an  intersection  of  two  one-way  streets,  Lee 

.   ,  6   .  . 

et  ax.   give  approximation  formulas  to  estimate  the  average 
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lys  that  result  from  this  control  policy.  However,  Pack 
roy  suggests  that  when  the  volumes  at  an  intersection  are 
heavy,    the    arrivals    are   normally    distributed. 

A   critical    intersection    control    scheme    for    a    real-time 
control    system   is    proposed   in   kef.    14,      According    to   this 
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scheme,    the    cycle    length    remains    constant    for    some    predeter- 
mined period   of   time     (i.e.,    15    minutes)    but    the    split    changes 
according    to    the    ratio    Qa/(Q/\+Q 3)    on    a    cycle-by- cycle    basis. 
The    quantities    Q^    and   QB    are    the    critical    queue    lengths    on 
the    conflicting    approaches   measured  by   the    detectors. 

Another    approach    to    critical    intersection    control   has 
been   suggested  by    Gordon.  Gordon    does    not    attempt    to   mini- 

mize   delay    at    the    intersection   but    rather   to   maintain    a    con- 
stant   ratio   of  the    queue    lengths    on   opposing    approaches.      The 
cycle    length   is    assumed   constant    and  the    splits    are    changed 
according   to   the    demand  so    that   the    ratio    of   the    actual   queues 
to    the    maximum    link    storage    space    on   both   phases    are    equal. 

The    objective    of    control    of    all    the    previously    discussed 
schemes    is    either   to    (a)    minimize    the    total    delays    or    (b)    re- 
strict   the    queues    as    much    as    possible    to   prevent    upstream 
intersection  blockage.       In   trying   to   optimize    the    operation 
of   a   traffic   signal,    one   would   like    to   integrate    the   two 
objectives    and   develop    a  new    control  policy   that   both   mini- 
mizes   the    delays    and   restricts    the   queue    lengths    at    cversatu- 
rated   intersections.      This    objective    is    accomplished  in   the 
subsequent    chapters. 


CHAPTER  3 
INTRODUCTION  TO  OPTIMAL  CONTROL  THEORY 

3.1.   Pre  face 

The    purpose    of   this    chapter   is    to    summarize    the    basic 
concepts    of   optimal    control    theory.       Extensive    development    of 
the    control    theory   is   beyond   the    objectives    of   this    chapter 
and   the    interested   reader   may    turn    to    References    16,    17,    18 
and   19    for   details    that    are   not    included  here. 

Before    discussing    the   basic    concepts    of    the    control 
theory,    a   simple    example    of   a   typical    control  problem  would 
be    instructive.      A   commercial    airliner  must    fly    at    the    alti- 
tude   and  speed  set   by    air   traffic    controllers.      Moving   the 
passengers    to   their   destinations    is    the    objective    of   the    air- 
liner.     At    the    same    time,    the    airliner  must  be    operated  within 
the    limits    that    the    aircraft    and  passengers    can   safely   endure. 

The    control   problem   in   this    example    is    that    of   designing 
the    system   so    as    to    achieve    the    objecti\res    while    satisfying 
the    operational    constraints.      Minimum  time    is    the    objective 
of   the    control,    subject    to    safety    constraints. 

Some    systems    arc    so    designed    that    once    started   they    oper- 
ate  without    requiring    further  knowledge    of   the   process    devel- 
opment.     Such   situations    are    examples    of   open    loon    control. 
pen    loop    control    is    the    simplest    and   the    cheapest    form   of 
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control.   It  generally  can  be  applied  In  situations  In  which 
performance  standards  are  not  very  important,  or  whe  re  the 
operational  mode  of  a  system  is  fairly  stable.   It  is  only 
when  performance  requirements  are  introduced  that  open  loop 
control  fails.   However,  more  elaborate  control  schemes  are 
costly  and  the  engineer  must  carefully  examine  the  possibility 
of  using  open  loop  control  before  proceeding  to  consider  the 
feedback  concept  and  closed  loop  control. 

In  the  closed  loop  control,  the  desired  operating  point 
(state)  of  the  system  is  measured  and  compared  to  the  actual 
operating  point.   The  difference  of  the  two  (error)  is  fed 
back  to  the  input  to  bring  the  actua 


desired  one.   Thus  closed  loop 


tal  operating  point  to  the 
•oritrol  requires  determination 


(measurement)  of  the  existing  operating  point  of  the  system 
at  various  times.   This  point  is  a  function  of  the  control 
previously  applied.   Since ' the  operating  point  is  sampled  at 
various  times,  the  terminology  "s amp led- data  control"  or 
"discrete  control"  is  frequently  used.   As  the  sampling  inter- 
val becomes  large,  the  control  approaches  open  loop  control. 
Conversely,  as  the  interval  nears  zero,  the  control  approaches 
continuous  feedback  control. 

The  various  control  problems  are  solved  by  mathematical 
optimization  techniques.   The  objective  of  these  techniques 
is  to  develop  .rigorous  procedures  for  optimizing  a  system 
that  can  be  described  mathematically.   The  nature  of  some 
systems  is  such  that  complete  mathematical  description  is 
impossible,  whereas  other  systems  can  be  completely  described. 
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Several    approaches    can   be    taken    to    the    development    of 
mathematical   methods    of   optimization,    all    of  which    lead   to 
essentially    equivalent    results.       The    variational    method   is 
most   widely    used.       This    method   is    based   on    the    analysis    of 
small    perturbations    and   therefore    lies    closest    to   the    usual 
engineering   experience.      The    general    approach    is    to   assume    a 
preliminary    solution    and   then    inquire    about    the    effect    of 
small    changes.       If   the    solution    is    in    fact   the    optimum,    any 
change   must    result    in   poorer  performance.      The   precise   mathe- 
matical   analysis    of   this    fact    leads    to  necessary    conditions, 
or   equations,   which    define    the      optimum.      Similarly,    the 
analysis    of   the    effect    of   small   perturbations    about    a  non- 
optimal   solution    leads    to   computational   procedures    which   pro- 
duce  better  solutions. 

3 • 2 •      Optimal    Control   System  Design 

Control,    in    the    sense    to  be    used   in   the    following   chap- 
ters,   is    concerned  with    affecting    the   physical   behavior    of 
systems.      Control   may  be    achieved  by  means    of  mechanical, 
electrical,    electromechanical,    electronic,    and   other   devices 
which   must    function  without   direct   human    intervention    or 
supervision . 

Obviously,    the    control    of    a    system   can   be    obtained   in    a 
number   of   ways.       Usually    the    optimal    one    is    sought.       The   need 
to    control    a   system   in    an    optimal    fashion  was    the    reason    for 
the    development    of   the    optimal    control    theory    and    design. 
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Optimal    control    design  methods    utilize,    as   will  be    seen, 
state    variables    to    describe    the    system   and    an    index    of   per- 
formance   (objective    function)-.       As    a    rule,    the    objective    func- 
tion   is    expressed   as    a  scalar   function    of   the    state    and   con- 
t  rol    vectors ,    i.e., 

t£ 

I    =    J      F(x,u)dt  (3.2.1) 

o 

where    I    is    the   performance    index,    and  x   and  u   are    the    state 
and   control    vectors,    respectively. 

The    only    constraints    imposed  upon    the    solution    are    those 
related  to   the   physical    restrictions    of   the    state    and  the    con- 
trol  vectors    x   and  u.      Furthermore,   no   assumptions    are   made 
as    to   system    configuration    or    linearity    of   the    control    strategy 

By   satisfying   the   physical    constraints    mentioned   above, 
a   u   solution   is    sought,    usually    denoted   as    u      .    or   u *  ,   which 

Op   L 

optimizes    the    index   of  performance.      To   solve    the    problem,    the 
differential   equation    of   the    state    vector   x   is    required,    i.e., 

x   =    f(x,u)  (3.2.2) 

Depending    on   the   nature    of   the   problem,    the    state    of   the 
system   at    the   beginning    and   the    ending    of    the    control   period 
may    or  may   not   be    specified. 

The    only    inconsistency    that    one   may    encounter   in    the 
above    problem   statement    lies    in    the    specification    of    the 
state    at    the    end   of   the    control    period.       One    must   make    sure 
that    the    system   is    controllable    and   that    the    prescribed   state 
is    reachable. 
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The  problem  of  finding  the  optimum  control  strategy-  u* 
is,,  in  general,  not  an  easy  one.   Only  in  very  simple  systems 
and  for  very  simple  I  functions  is  it  possible  to  obtain 
explicit  solutions  for  u*.   In  most  practical  cases,  one  must 
be  content  with  a  numerical  solution  generated  by  a  digital 
computer,  which  is  incorporated  as  part  of  the  system.   One 
of  the  advantages  of  this  numerical  approach  is  that  one  is 
not  limited  to  only  those  I  functions  which  result  in  analyti- 
cal convenience. 

Optimal  control  methods  can  be  applied  to  nonlinear  and 
time  varying  systems.   Furthermore,  they  incorporate  all  the 
advantages  of  the  modern  digital  computers.   That  is,  they 
leave  the  computational  difficulties  to  the  computer,  allow- 
ing the  designer  to  devote  more  time  to  analytical  problems. 

Clearly,  the  objectives  of  the  control  depend  on  the 
nature  of  the  specific  problem.   There  are,  however,  some 
objectives  in  common  with  several  optimization  problems.   For 
example,  the  objective  of  the  control  may  be  to  bring  the 
state  of  the  system  as  close  as  possible  to  the  zero  state 
at  a  given  time.   This  is  referred  to  as  the  terminal  control 
problem.   Another  objective  could  be  to  bring  the  state  of  the 
system  to  the  zero  state  in  minimum  time.   This  is  the  minimum 
time  problem.   The  objective  of  the  minimum  energy  problem  is 
to  bring  the  state  of  the  system  to  the  zero  state  with  mini- 
mum control  effort.   tn  the  pursuit  problem,  the  objective 
is  to  bring  the  state  of  the  system  to  a  predetermined  state 
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in    a  minimum  time.      The    time    at  which   the    desired  state    is 
reached   is    called   final    time    and   it   will   be    denoted  lie  re    as    t 


3.3.       The    Concepts    of   State    and   State    Variables 

The    concept    of  system   is    fundamental    to   optimization 
theory.       One    can    speak    of    a   system   of   equations    or    a  physical 
system,    both    of  which    fall   under   the   broad  meaning   of  the    term 
system.      Systems    are    governed  by    rules    of   operation;    they 
generally    receive    inputs    and  produce    outputs    affected  by   the 
inputs    and  the    rules    of   operation. 

In    addition    to   inputs    and   outputs    and   the    rules    of   oper- 
ation,   the    state    of   the    system   is    required   for    complete 
description.       In   some    instances,    the    description    of   the    system- 
can   only  be    approximated,    in    others    the    description   may  be 
exact.      To   illustrate    the    concept   of   state,    suppose    that    the 
equations    characterizing   a   system   are   known;    suppose    also 
that    outputs    are    to  be    determined  which    depend  on   the    inputs 
and/or   changes    in    the    system   after   a   certain    time    x.      To 
accurately   predict    the    response    of   the    system   after   time    T, 
knowledge    of   the    state    of   the    system   after   time    x    is    the    addi- 
tional   information    required.  ■    The    state    at    any   time    t    is 
represented  by    the    vector   x(t)    with   n   elements    x    (t)  ,    x7  (t)  , 
...xn(t);    one    may    interpret    the    n    independent    x    variables    as 
carriers    of   the    full    information    about    the    transient    states 
of   the    system. 

Direct    control    of    the    system   is    imposed  by   means    of   m 
control    forces    u,  ,    ^  ,    .  .,,    Ujn,    which    are    called    control 
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variables.       These    control    forces    are    applied  by    a    controller, 
which    always    constitutes    both    the    brain   portion    and   the    brute- 
force    portion    of   the    overall  system.       The    controller   takes 
proper   control    action   based   upon    input   or    reference    commands 
ana   information    obtained   from  sensors    concerning   the    actual 
state    of   the    system.      The    controller  may  be    a  human    operator; 
the    system   is    then   manually    controlled.      In    an    automatic   con- 
trol  system   a  machine   has    replaced   the   man. 

Initially,    at    t   =    0    the    total   system   state    can  be 
expressed  by   the   n  numbers    x]  (0)  ,    x2(0),    ...,    x    (0).      Under 
the    influence    of   the   m   control    forces    and   the    inputs,    the 
state    of   the    system  will    change    and  thus    the    state    variables 
are    changing  with    time.      Although    the    symbol   x   does   not    reveal 
it    directly,    each    state    variable    as    a   rule   has    a  very   obvious 
p h y  s  i  c  a  1   me  an  in  g . 

The    evolution    of   the    system   in   time    can  be    described   in 
terms    of   the    changes    of   its    state.      Since    these    changes    are 
usually    affected  by   external    inputs,    it   is    convenient   to 
represent    the    transformation    in   state   by   the    transition 

SCV         E(t3  S(t£)  ,  (3.3.1) 

which    is    interpreted   as:       the    state    at    time    tQ    is    transformed 
into    the    state    at    time    tf    (tQ    <    t.,-)    by    the    action    of   u(t)  .       To 
illustrate    this    idea,    consider   the    set    of    ordinary    differen- 
tia.!   equations    corresponding    to    the    general    continuous    time 
fo  rrn , 
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Ay 

3t"  xl(t'}  =    f1U1,x2J...,xn5    VU2"-->V    t) 

d^  . 

3t  X2  (t }  ~    f2 (xl » x2  '  •  •  • ' xn  »    ul ' u2 ' •  • • » um  »    t) 


dx 

n 


3t      =    Xn(t}    =    f5(xl'x2'---'xn'    Ul  >u2  '  "  "  "  '  Um »    ^     (3-3.2) 

where    the    x±    and  u£    are    functions    of   time    t.      As    mentioned 
earlier,    the    state    at    any   time    t    is    described  by   the    vector 
x(t)    and  the    control   is    exerted  through   the    vector   u(t)  .       In 
vector  notation    the    system   of  Eqs.    3.3.2    can   be   written    as 

x(t)    =    f[x(t),    u(t)  ,    t]  (3.3.3) 

where    £  is    a  vector  with  n   elements    f        f  f 

Associated  with    the    set    of   differential   equations    is    a 
corresponding   set    of   initial    conditions   which    is    Indicated   as 

x(tQ)    -    x(t-O)    =    x(0)  (5^4} 

where    it    is    assumed   for   convenience    that    t      equals    zero. 
The    solution    of   the    differential   equations    f.     (i    =    l3    2, 
. . . ,    n)    is    frequently    called   the    trajectory    of  x(t)    which 
starts    at    xfO)    and  passes    through   n-  dimensional    space    up    to 
X'-"M-       The    actual    determination    of   such    a    trajectory   may    or 
may   not    be    simple    computational   matter.       When    f   is    nonlinear 
It    is    necessary    to    turn    to   numerical    techniques    to   evaluate 
the    trajectory. 

When    uft)    =    0    the    system   is    called   free    or    unforced.       If 


F[x(t),    u(t),    t]    -    £~[x(t),    u(t)J  (. 
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where    f   does   not    contain    t   explicitly,    the    system   is    called 
stationary.       Finally,    if    a   system   is    both    free    and   stationary 
it    is    called   autonomous. 

3.4.      The    Performance    Index 

The    term  performance   measure    or  performance    index   is 

used  to    denote    that   which   is    to  be   minimized   or   maximized    (to 
be    extremized) . 

To   measure    the    "goodness    of   control"    in   some   meaningful 
manner,    it   is   necessary   to    introduce    a   criterion  which   speci- 
fies   how  well    the    system   is    doing.       This    criterion    is    the 
performance    index  mentioned   above.       In    alternative    terms    one 
needs    to   know   how    close    the    control    achieves    any    goal   which 
is    set    up    for   it. 

Selection    of   the   performance    index   is   not  always    an   easy 

matter.      As    an   example,    suppose    that   one    seeks  to   minimize 

the   magnitude    of   a  system  error  e    5    e(t)    which  is    a   function 
of   time    and   is    characterized  by 

e    -    q(e,u,t)  t&   <    t    <    tfe  (3.4.1) 

where    t&   and   tfe    are    specified,    e(ta)    is    given,    q   =    q(e,u,t) 
is    a    given    real    valued    function    of   its    arguments,    and   u   i    u(t) 
is    a  bounded   control    action  which    is    selected   to    attain   mini- 
mum  error    over   the    time    period    defined  by    t      <    t    <    t    .       The 

a  —   —  b 

manner  in  which  the  magnitude  of  c(t)  is  to  be  minimized  is 


act  obvious.   One  may  cl 


y  cnoose  to  minimize  the  integral  of  th 


e 


absolute    value    of    the    error   over   the    closed   interval    it      t     !• 


a'    n 
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or  he    may    choose    to   minimize    the    integral    of   the    squared 
error;    or    finally   he    may    choose    to   minimize    some    other   inte- 
gral   of    a   positive    definite    function    of   the    system   error. 

Without    loss    of   generality,    in    an   optimal    control   problem 
it    is    required   to   extromize    the    scalar   function    l[x(0),    t,], 
called   the   performance    index,    and  expressed   as 

n 
l[x(0),    tf]    =    _E      Cix.(tf)    =    c'x(tf)  (3.4.2) 

where    c'    -    [c,  ,    c        .„.,    c    ]    and  the    c .  '  s    are    constants.      The 

-L  Li  IX  J_ 

notation  here  means  that  I  depends  on  the  starting  value  x(0) 
and  the  final  time  t,,  In  some  circumstances  the  performance 
index   is    expressed   in    a   different   manner. 

There    are    a  number    of    interesting   points   which    require 
further   discussion    regarding   Eq,     3.4.2.       Since    the    origin    is 
assumed   to  be    the    desired  state,    it    follows    that    the    terminal 
control   problem   is    considered.       If    c,    i    =    l,2,..,,n    are    taken 
as    1.0,    the    result    is    an    unweighted,  minimization   of   the    devia- 
tion  of   the    state    at    time    t£:   bv   setting   some    of  the    c's 
equal   to    zero   these    states    are    ignored   since    their   deviation 
at   time    tf  has   no   effect.       Finally,    it   is   noted  that    only 
those    values    at    time    tf,    when    the    goal    is    reached,    are    in- 
volved;   how    this    final    state    Is    reached    is    unimportant    in   the 
sense    that    the    trajectory    actually    followed   is    not    involved 
i  n    th  e    p  c  r  f  o  rm  an  ce    i  n  de  x  , 

Although  this  performance  index  satisfies  a  number  of 
important  physical  considerations,  It  does  have  the  short- 
coming   that    the    motion    from   x(0)  ,0    to    x(t ,.)  ,t,   is    ignored 
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Th:Ls    shortcoming   can   be    improved   if   the   performance    index    is 
redefined    as 

tf 

ICxC0))    tf]    =    /      f0[x(t),    u(t),    t]dt  f3    4    31 

o  J 

where    fQ    is    a   scalar   function   with   the   property   that    its 
integral    is    a  positive    number.       In    this    manner   the    overall 
trajectory    is    involved   in    the    minimization. 

It   should  be   noted  that  when   the    f   function    of   the    sys- 
tem  equations    contains    time    explicitly,    this    time    inclusion 
can   be    removed  by    introducing    a  new    variable    x         (t)    with    the 
properties 

Vl(t]    =    X      and     xn+i(0)    =    0  (3.4.4) 

so  that  t  can  be  replaced  with  j^.   Thus  the  form  fQ(x,u,t) 
is  equivalent  to  the  simpler  form  fQ(x,u),  which  may  be  used 
without  loss  of  generality. 

In  summary,  the  previous  discussion  suggests  that  when 
the  system  starts  from  a  given  state  and  time,  x(0)  and  0, 
the  choice  of  u(t)  automatically  determines  a  trajectory  of 
x(t)  in  x,t  space.   The  choice  of  u(t)  is  usually  subject  to 
Upper  and  lcwer  bound  constraints  (i.e.,  the  control  action 
is  bounded).   Of  those  trajectories,  the  "best"  one  is 
selected  by  comparing  the  values  of  the  performance  index. 
Thus,  the  performance  index  allows  the  selection  of  the 
optimal  trajectory. 
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5.5,      Pent ry agin ' s    Maximum  Principle 

In    this    section    the   maximum  principle    due    to   Pont ry agin 
and  his    collaborators    °   will 'be    presented,      A    rigorous    proof 
of   the   maximum  principle    cannot   be    given  without   excessive 
mathematical    development   not    justified  here.      A   rigorous 
derivation   based    on    geometric    arguments    is    given   by   Pontrya- 
Sin   ®Ji  M.-  A  more    readable   but    less    rigorous    demonstration 

than   Pontryagin's    is    given  by  Athans    and   Falb.17      Other  more 
simplified  versions    are    given  by   Denn10    and   Coppel,19    and  the 
interested   reader  may   turn    to    these    references,  to    find   the 
proofs    that  will  not   be    included  here. 

The  maximum  principle  is  applicable  to  both  minimization 
and  maximization  problems  since  minimization  of  a  function  is 
equivalent  to  maximization  of  the  same  function  with  negative 
sign.  Thus  Pontryagin's  principle  can  also  be  referred  to  as 
minimum  principle  if  the  objective  is  to  minimize  the  per- 
formance   index. 

It    is    convenient    to   explain   the   minimum  principle   by 
considering   the    following   general    control    problem. 
Problem:      Minimize    the   performance    index 

tf 

C    =    U(t),    tf]    -    /      fQ[x(t),    u(t)]dt  (3.5.1) 

o 

described  by    the    n    dimensional    vector 

x(t)    -    f[x(t) ,    u(t)]  (3.5.2)     ' 

subject    to    the    final    cond'j  Lions 
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gxU(tf)j    -    0 


find  the    initial    conditi 


i    =    1,2, 


(s    <   n)         (3.5.3) 


on 


x(0)    =    0 


(3.5.4) 


The    performance    index    is    to   be   minimized  by   proper   selec- 
tion   of  the    control   variables    U][ ,    u£ ,    ...    n^ .      The    control 
variables    are   not    arbitrary  but    they  belong   to   a   usually 
closed   and  bounded  set   U    called   the    control    region   or   the 
admissible    control    domain.       In    the    above   problem   the    final 
time    is   not    specified.       It    is    then   said  that   tc   is    free    to 
l    this    formulation    it    is    assumed   that    the    functions- 


vary.       I' 


Li    (i    _    L  5    2  »    ••■>    n)    as   well    as    df./dx   are    continuous 


The    solut 


ion 


proceeds    by    slightly    reformulating    the-prob 
lem   by    the    introduction    of   the    variable 


xQ(t)    =    f0[x(t),    u(t)] 


(3.5.5) 


■ith    zero    initial    condition.      The    system  is   now    of   dimension 


n+1,    i.e. 


xn  >    xi  >    X9  ' 


It    is   noted   th; 


p    ^2  '     '  "  "  '    An '       *«»    as    iiuLea    inai    if   Eq.     3. 
includes    t    explicitly,    t    can   be    removed  by    defining    a   new 
variable 


x 


n+1 


t      so   that      x         (0)    =    0      and  x      , 
n    i  n  +  l 


=    i 


(3.5.6) 


thus    the    dimension    of   the    system   Increases    by   n+2. 

To   simplify   the   notation,    the    Hamiltonian    formulation   of 
classical    mechanics    is    Introduced. 


he   II  ami  1 1  en  i  an    fun  ct  i  on 


is    defined    as 
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n  __ 

H(A,    x,    u)    =      I      ^(x,    u)  (3.5.7) 

where    the    variables    \n ,    X.       a  a      arp    fim  r-t-i  nn~    ^p  +•■;«, 

0'      i'      2'    •'■'      n      x u    iUn(-tioiii    oi    Lime 

and    they    are    called   adjoint    variables.       The    adjoint    variables 

are    defined    as 

V^    =    \\    H1   V1-1  '  (3.5.8) 

]  =0         i       J 

From   Eq.     3.5.7    one    obtains 


ITT  _    fi    -    xiCO  i    =    0,1,2,...  ,n         (3.5.9) 


and 


9  H  n  ^  ■ 

3TT  =    ,E      Xj    7TTT  i   =   0,1,2,... ,n        (3.5.10) 

i        j  =  u      J         1 

From  Eqs.     3.5.8    and   3.5.10    it    follows    that 

3H 


A    (10    - 

J-  d  X  ■ 

1 


i   -    0,1,2,.. . ,n        (5.5.11) 


In   general,    the   minimum  principle    gives    the    necessary 
conditions    for    optimal    solution    of   the   problem.       In    fact,    the 
principle    states    that    if   optimal    solution   exists,    then   there 
exists    a  nonzero   vector  T(t)    satisfying   Eqs.    3.5.9    and   3.5.11 
In    addition,    the    following    conditions    must   be    satisfied: 

1.  The  optimal  control  u*(t)  which  minimizes 
1 -Lx(0)  ,  tf]  must  minimize  the  Hamiltonian 
£ un  c t ion   H    at    e  a ch    t i me    point. 

2.  If    the    final    time    tf   is    free,    the    minimum 
value    of    the   Hamiltonian    function    H    at    the 
final   time    is    zero.      Also,    A0(tf)    <    0. 


inial   trajectory 


furthermore,  it  can  be  shown  that  along  the  op- 

the    Hamiltonian    is    a    constant,    i.e.,    II    is    equal    to    zero,    not 

only    at    tf  but    also    at    any    time    in   the    interval    [0,    t  r]  .      The 
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optimal    solution   must    also    satisfy    the    initial    and    the    final 
conditions    as   well    as    the    constraints    placed   on    the    control 
variables. 

In    the    previous    formulation    the    values    of   the    state    vari- 
ables   at    the    final    time   were   not    fixed.      However,    the    same 
results    apply    to   fixed   final    conditions    x(tf)  .       If  the    final 
state    is    the    origin    it   can  be    shown    that    An    =    1.0. 

u 

Finally,  it  must  be  emphasized  that  In  all  the  formula- 
tions to  this  point  the  final  time  t,  is  unspecified  (free  to 
vary).   If  tf  is  fixed  the  theory  still  applies  with  the  only 
difference  being  that  the  constant  value  of  H  along  the 
optimal  trajectory  is  different  from  zero. 

If  maximization  of  the  performance  index  is  considered, 
the  optimal  control  u*(t)  must  maximize  the  Hamiltonian  at 
each  time  point.   Regarding  the  maximum  value  of  the  Hamilton- 
ian a  few  comments  are  in  order.   Frequently  the  maximum  value 
is  obtained  by  setting  3H/3u  equal  to  zero;  that  is,  by  actu- 
ally differentiating  the  Hamiltonian  with  respect  to  u  and 
setting  the  result  equal  to  zero.   In  this  differentiation, 
A  and  x  are  treated  as  constants.   When  u*(t)  is  Interior  to 
any  constraints,  it  is  necessary  that  3H/3u  equals  zero  for 
maximum.   This,  however,  is  not  true  when  the  optimal  controls 
are  on  the  constraint  boundary. 

There  are  a  number  of  further  important  variations  on 
the  main  theorem  of  the  maximum  principle.   Of  particular 
importance  is  the  case  where  the  state  variables  are  con- 
strained over  the  entire  trajectory.   The  complexity  of  this. 
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formulation,  however,  precludes  presenting  the  details  here. 
The  interested  reader  may  consult  the  references  mentioned  at 
the  beginning  of  this  section  for  further  information  on 
this  point. 


CHAPTER  4 
SINGLE  OVERSATURATED  INTERSECTION 

4.1.   Formulation  of  the  Unconstrained  Problem 

At  an  isolated  intersection  serving  n  competing  traffic 
streams,  cars  arrive  at  rates  q. (t)  (I  =  1,  2,    .  ..,  n) .   The 
arrival/rates  are  time  varying  but  have  a  repetitive  and  pre- 
dictable pattern  from  day  to  day.   The  cars  are  discharged 
during  the  appropriate  green  phases;  the  rate  of  discharge 
during  the  green  Interval  is  equal  to  the  saturation  flow  as 
long  as  there  is  sufficient  demand.   When  the  queues  dissipate 
the  rate  of  discharge  is  equal  to  the  arrival  rate.   If  the 
demand  is  sufficiently  low,  there  are  no  queues  at  the  end  of 
the  green  interval.   The  average  green  time  per  cycle  is 
directly  proportional  to  the  average  arrival  rate  and  In- 
versely proportional  to  the  saturation  flow,  i.e., 

57-  ■  —  +   gi  = i  =  l,2,...,n      (4.1.1) 

i  i 

where  g.  =  the  effective  green  time 
c  =  the  cycle  length 

q^  =  the  average  arrival  rate  during  the  cycle 

5  ■  -  t  h  e  s  a  t  u  r  a  t  i  0  n  f  1  aw . 
To.  general,  the  policy  followed  by  traffic  analysts  is  to 
allocate  the  total  available  green  time  in  proportion  to  the 

3  7 
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demand  so    that   the    same    degree    of  saturation    is    allowed   on 
all    conflicting    streams.       That    is,    the    effective    green    inter- 
vals   must  be    selected  such   that    the    following   relationships 
are    satisfied: 


*1 


n2 


S      cr 
ltol 


S2«2 


Ln 
s    g 


20    ^ 


(4.1.2) 


According  to  Webster,*  the  above  relationship  approxi- 
mately minimizes  the  average  delay  of  the  users  at  an  under- 
saturated   intersection. 

Consider   that   the    demands    at   the    intersection   increase 

for   some    time   period  such    that    the    capacity   is    exceeded   and 

the    intersection   becomes    overs aturated,       For   simplicity      it 

will   be    assumed   that   there    are    only   two    competing   traffic 

streams    at    the    intersection    and   that   without    loss    of   general- 

:Lt>'    si    is    greater   than   s2<       The    intersection  becomes    oversatu- 
rated  when 


q- 


L    >    c 


ql         ^2  ] 

or      — -  +    — —  >    i    _   i± 

Sl  S7  c 


(4.1.3) 


where    L   is    the    total    lost   time   per   cycle.       In   this    case,    the 
theories    that   have   been    developed   for-  unders  aturated    condi- 
tions   no    longer    apply    since    they    do   not   minimize    the    total 
i  n  t  e  r  sect  i  on    de  I  ay  . 

The    peak   period,    as    defined   in    this    dissertation,    is    the 
time   period    from    the   beginning    to    the   ending    of   queuing 'con- 
ditions   on    any    approach    to   the    intersection    under   considera- 
tion,      fhe    objective    of   the    control,    strategy    is    to   minimize 
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the    aggregate    delay    of  both   streams    during   the    entire    peak 
period.       In    developing   the    theory   it  will   be    assumed   that    the 
history   of   traffic   arrivals    at   the    intersection    during   the 
control    period   is    known,    and    that    the    demand    is   not    affected 
by   the    control    decisions.      These    assumptions    are    fairlv    r-^i- 
istic    and  have   been   used,  previously20    in    the   setting   of  pre- 
timed   signals . 

Problem   formulation   is    more    easily   understood   through 
examination   of  Figure   2.1,    in  which    the    cumulative    demand 
and  service    curves    are   plotted  versus    time    for   one    approach.* 
The    area  between   these    curves    from   time    zero   to   time    T    (the 
end   of  the    overs aturated  period)    is    a  measure    of   the   total 
delay    to    the    users    of    the    particular    approach.       The    saw- 
toothed  pattern    of   the    cumulative    output    curve    is    caused -by 
the    intermittent    service    of   traffic  by   the    signal.       The    verti- 
cal   distance   between    the    curves    represents    the    queue    length 
at    a   given   time.      The   horizontal ' distance ,    such    as    t    -t    , 
represents    the    delay   of   the    individual    vehicle    that    joins    the 
queue    at    time    t±    and    is    serviced    at    time    t? . 

It  will  now  be    assumed   that    the    saw- toothed  pattern   of 
the    cumulative    output    curve    can  be    represented  by   a   straight 
line.       This    assumption    is    justified  by    the    fact    that    the    addi- 
tional   delays    caused  by    the    saw-toothed   pattern    are    negligible 
in    cases    of  heavy    overs aturation.      The    saw-toothed  pattern 
can    also    he    taken    into    account    by    shifting    the    curve    G   t 


.0   the 


*The    notation    and    the    formulation    of   the    problem   in   this 
section         aie         those    of    Gazis.8  i  "  lx* 
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right  by  an  amount  equal  to  1/2  (red  Interval).  The  cumula- 
tive input  and  output  in  a  time  interval  from  zero  to  t!  arc 
given   by 


Q(t)     =    /       q(t)dt  r4    x    4, 

o 

t' 

G(t)    =    /      Y(t)dt  f4    ,    51 


Y(t) 


sg(t) 


c  (4.1.6) 


where  q(t)  is  the  demand  rate  (slope  of  the  input  curve)  and 


,ii:ie   l. 


y(t)  is  the  service  rate  (slope  of  the  output  curve)  at  t: 

It  should  be  noted  that  the  rate  q(t)  is  time  varying  and 
is  independent  of  the  control  decisions.   If  green  time  is 
tree  to  vary  between  a  maximum  and  a  minimum  value,  then  the 
slope  of  the  service  curve  y(t)  Is  also  time  varying,  as  shown 
in  Figure  4.1.   If  g^  and  g^^    are  the  bounds  placed  on  the 
effective  green  time,  then  the  service  rate  will  also  have 
upp  e r  and  1  owe r  b o un ds  de fined  as 

rmin      c -  '  ClJ  -  Sax  =  — F (4.1-7) 


The  problem 


.em  or  optimizing  the  performance  of  the  traffic 
ignal  will  now  be  formulated  as  an  optimal  control  problem. 


suppose  that,  t  L  is  t:he  end  of  the  overs  aturation  period:  th 
2       t  j 

i]     :  '<         -  [ -J   -  (O  -G  :  (t  J  IctL  f.l   I   ;, 

i  - 1  o     J       J  "   " 


0  Ti 


Q1,G1 
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Qi  Ctl 


Q23g2 


nuny 


Q9(t) 


Figure    4. 
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SJnCS    Vt}_GjCt:)    =    XjCt)    =    qusue   l£ngth    at    time    t    (on    th< 
j    ■     approach),    Eq.    4.1.8    can  be    rewritten    as 


D    = 


2       T 

A    f   ^(t)dt        /   x    (t)dt   +    /   x9(t)d 
j=l    o      J 


o 


T 
/ 
o 


T 


=;    -r    [x,  (t)+x?(t)]dt 

0 

The   queue    length   x    (t)    can  be   expressed   as 


f4    1   9 ") 


r^s    1 
'11 


I 


t    (4.1.10) 


XiOO    -    x1(0)+Qi(t)-G1(t)    =    XjCO+Qj^Ct)- 

where  x^O)  is  the  queue  length  of  approach  1  at  time  zero 
and  has  a  constant  value.  Differentiating  with  respect  to 
time,    the    following   is    obtained: 


dx 

dt 


1         «     .     dQl         slSl 


0    + 


dt 


qx(t)-u 


(4.1.11) 


where 


dO- 


q3Ct)    -   j^~     and     u  =■  Sj_gl/c 

Similarly , 

*2(t)    =   x2(0)+Q    (t)-G 2(t)    =   x-(0)+Q,(t)- 


(4.1.12' 


S7§ 


7&? 


t    (4.1.13) 


ma 


dx2 
dt 


0    +    q?(t) 


2g2 


■    q2Ct)    -    -^   (c-gl-L) 


q2(t)     -    s2(l^-) 


S2gl 


q?ct)  -  s,  ci-=-) 


S2SlSl 


c 


c    s 


s. 


q?  (t)   -  so  (1  -■=•)   +  —  i 


(4.1.14) 
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If  gmax>  gmin  are  the  uPPer  and  lower  bounds  placed  on 
the  effective  green  time  g±,  then  u  will  also  have  an  upper 
and   lower  bound   defined   as 

(I) 


u 


mm 


c      ff(l). 

1   mm  l^niax 

— <    u   <    u  =      L   LdX 

c  —       —     max  c 


At    the    end   of  the    overs aturated  period    (or    final    time)    the 
queues    on  both    approaches    must   equal    zero,    i.e., 


xi  (t,)    =    x7(t,)    =    0 


2VU1- 


(4.1. IS) 


Since  the  rush  period  begins  at  time  zerc 


^(0)  =  x2(0)  «  0 


(4.1.16) 


The  minimization  problem  can  row  be  stated  using  these  deveT 
oped  constraints  and  boundary  conditions. 
Problem:   Minimize  the  delay  function 


D  »   /      (x1+x2)dt 


with    t,    =    free    to    vary    (4.1.17) 


suo'iect    to 


dx 


1 


dt 

dx 

ar 


£1     =    q,  (t)     -    u(t) 


2 


2 .    -    q2 


(t)    -    s-U-fe    +   ~  u(t) 


(4.1.18) 
(4.1.19) 


w  1 1  h    t  h  c   b  o  un  d  a  r  y    c  o  n  d  i  t  i  o  n  s 


x]  (0) 


x..  ft,  ) 


(4.1. 20) 


x,  (0) 


"2 


f  +■ 


(4.1.21 
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The    function   u  is    defined   as 


u(t) 


5lgl(t) 


(4,1.22; 


and   is    an    admissible    control    in    the    interval 


slSW/c 
lsmm 


u    -      <    u  <    s ,  e      w  c  =    u 

mm   -  u  -     ltomax/c  max 


(4.1.  25) 


The  problem  may  be  restated  using  the  following  trans 
formations.   Introduce  a  variable  xn  such  that 


•0 


dx 


0 


dt 


x,  +  x. 


(4.1.24) 


with  initial  condition 


x0(0)  -  0 


(4,1.25) 


and  free  final  condition,  i. 


■o 


(V 


=  free  to  vary 


(4.1.26) 


The   problem  now    takes    the    following   equivalent    form: 

Problem:      Minimize    the    delay    function    (or  performance 
index)    D 


Min    D 
u(t)  ,t] 

subject    to 


0      1 J 


E   Max    F 


u(t)  ,t. 


^0(t13 


(4.1.27) 


dx, 


■0         "1 


+     x .-, 


(4.1. 2  3) 


at 


q-,  CO   -  u(t) 


(4.1.29) 
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cbc,  s 

3t~  =    X2    =    ^2^     "    S2^1_c^    +    ~  U^t}  (4.1.30) 

with   boundary    conditions 

xxC0)    -   x^)    -    0  (4.1.31) 

V°)    =    W    =    °  (4.1.32) 

x0(°)    ■    0    ,      xQ(t1)    -    free    to    vary  (4.1.33) 


and   the    admissible    control    domain 

1   min   -  i,  <   „   ^      lgmax 

"c  Umin   <    u   <    — c =    Umax  (4.1.34) 


and  from  here    on   the    equivalent   maximization  problem  will   be 
considered.       The    above    is    an   optimal    control   problem  in   which 

1.  the    system   is    the    intersection. 

2.  minimization   of   the    total    delay    is    the    objective 
Of   the    control.       The    objective    function   is    a 
function    of   the    state    variables    at    the    final 
time    tj    defined   as    the   end  of  the   overs aturation 
period. 

3.  x.,  ,x,    are    the    state    variables    describing    the 
system. 

4.  u   is    a  bounded   control    variable. 
5-       tj    is    an    optimization   variable. 
6.       t    is    the    independent    variable. 

7-       xq    is    an    artificial    state    variable. 

The    problem    can   be    solved  by    using   Pont ryagin ' s    maximum 
principle,         explained   in    Chapter    5.       The    solution    proceeds 
by    introducing    the    Ilamiltonian    function   H 


fi   =    V:0    *    Xlfl    +    A2f2    =      L      Ai£i  C4.1 

i  =  0 


,    ae lined    as 
Vi  (4.1.0 
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where  \.,  i  =  0,1,2  are  functions  of  time  and  they  are  called 
adjoint  variables.   For  the  optimality  of  the  solution  the 
adjoint  variables  must  satisfy  the  following  differential 
equations : 


dA 


0 


SH 


dt 

3x0 

dx1 

3H 

dt  ■  -  " 

3xx 

dA? 

3H 

dt 

3x2 

Substitution 

of  f 

yields 

(4.1.36) 


(4.1.3  7) 


(4.1.38) 


f ] ,  f-  (Eqs.  4.1.28-4.1.30)  to  Eq.  4.1.35 


0'  *1»  "2 


H  =  AQ(x1+x2)  +  X1[q1(t)-u(t)] 


X2[q2(t)  -  s  (l-£)  ♦  ~  u(t)] 


1 

and  Eqs .  4.1.36-4.1.38  t ake  the  f o 1 lowin a    form : 


(4.1 .39) 


□.a, 


dt 

dA. 

aT 

dA_ 
at 


=  0 


(4. 1.40) 
(4.1.41) 
(4.1.42) 


Because  xQ  (t^    is  unspecified,  the  adjoint  variable  A   at  th 
final  time  must  satisfy  the  condition 


w 


3F 


n  ■  i J 


(4.1.43) 


ana  since  F  = 


~xn(^1J,    it  follows  that 
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VV  =  -1 


(4.1.44) 


Integration  of  Eq.  4.1.40  gives 


^Q(t)  -  kQ  =  constant 


(4.1.45) 


and  from  Eq, 


4.4.44  it  follows  that 


0    K0     1 


(4,1.46) 


Substitution  of  Eq.  4.4.46  into  Eqs .  4.4.41  and  4.4.42  yiel 


yield; 


d^/dt   =    +1      and      dA2/dt   =    +1 
Integrating   Eqs.    4.4.47,    one    obtains 


(4.1.47) 


Vt)  =  t  +  kx 


(4.1.43; 


'  an  d 


A2(t)  -  t  *  k2 


(4.1.49) 


where  kj  and  k2  are  the  constants  of  integration.   Substitu- 
tion of  Eqs.  4.1.44,  4.1.48  and  4.1.49  into  Eq.  4.1.35  results 
in 


L.  s? 


H  =  C"1)Cx1+x2)+(t+k1)[q1-u]  +  (t+lc2)[q?-s7(l-^)+-i  u] 


C   s 


[-t-k1+Ct+k2)ii]u-(x1+x2)  +  (t+k1)q1 


+  (t+k2)[q2-s2(l-|)J 

s2         s 
-  [(~-l)t+(k2  -£-  -k  )]u 

1      z'  ~1   L 


L 


+  {^l+ci2-s2(i-c)]t^Xl+x23+]cl^l+k2^2-s2^1-ci)] 


(4.1.  SO) 


48 
:his    equation    can  be    rewritten   in    a  more    simple    form   as 
H  =    zu  +   w 


(4.1.51) 


where 


So  S 

2       ,w     .      „  2 


Z    =    (it-1}t    +    (k2    sT^V  (4.1.52) 


'1 
an  d 


L 


W   =    {ql  +  cl2-s2a-^    t-Cx1+x2)^iqi+k2    q2-s2(l-|)}(4.1.53) 

Pontryagin's   maximum  principle16    states    that    for   optimal 
solution    the    following    conditions    must  be    satisfied: 

1.  The  optimal  control  u*(t)  must  maximize  the 
Hamiltonian  (Eq.  4.1.51)  at  each  time  point. 

2.  Since  the  final  time  at  the  present  problem 
is  free  to  vary,  the  value  of  the  Hamiltonian 
H  at  the  final  time  must  equal  zero.   Further- 
more  H  is  constant  and  equal  to  zero  not  only 
at  the  final  time  but  also  for  the  entire 
control  interval  [0,  t], 

The  optimal  solution  can  be  obtained  by  proper  determina- 
tion of  the  control  variable  u  so  that  the  above  conditions 
are  satisfied.   From  Eq.  4.1.51  it  is  seen  that  the  Hamilton- 
ian H  is  a  linear  function  of  u,  therefore 

3H/5u  =  z     .  •       (4.1.54) 

In    order    to    satisfy    condition    1    as    stated    above,    it    is    neces- 
sary  to    examine    the    sign    of    z   which   may  be    negative    or   posi- 
tive   or,     finally,    it    is    possible    that    z    equals    zero.       The 
optimal    control    u*(t)    when    z    is    greater   than    zero    or   when    z 
is    less    than    zero    can    be    determined   if    the    II   versus    u   curv 


es 


are  drawn  (Figures  4.2  and  4.3).   From  Figure  4.2 


one  can 


s  i . 


verity  that 


3H 

3u 


v—  =    z   <   0 


u-   =    u 


mm 
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(4.1.55) 


Similarly,    from    Figure    4.3    it    is    clear    that 


3H 

^—  =    z    >    0    ■+    u-    =    u 
ou  max 


(4.1.56) 


:uations  4.1.5b  and  4.1.5  6  are  the  results  of  condit 


ion  1 


according  to  which  H  must  be  maximized  at  each  time  point. 
However,  when  z  equals  zero  conclusive  results  cannot  be 
drawn  by  plotting  the  H  versus  u  curve  as  before.   In  this 
case,  the  problem  is  solved  by  noting  that  z  is  a  linear 
function  of  time.   Therefore  there  will  be  at  most  one  time 
point  t  at  which  z  becomes  zero.   At  this  time  point  z  chang 
sign,   Without  loss  of  generality  it  has  been  assumed  that 
s1    is  greater  than  s2  and  the  ratio  s2/s,  is  less  than  1. 
Then  from  Eq.  4.1.52  it  is  seen  that  the  coefficient  of  t  is 
negative ,  i.e., 


'2/Sl 


-  1)  <  0 


(4.1.5  7) 


therefore  z (t)  is  a  straight  line  with  negative  slope,  as 
shown  in  Figure  4.4.   Figure  4.4  shows  that  in  the  interval 


L 


z  is  positive,  whereas  after  this  interval  z  is  nega- 


tive.  Consequently,  at  time  t  the  o 
i.e.  , 


Ftimal  control  is  u  - 

mm  ' 


3H 

3u 


U" 


u 


mm 


(4.1.5  8) 


In    summary,    the    preceding    analysis    indicates    that 


if   csli/'du 

is    u* 


z    is    positive,    the    optimal    control 


u 


max 


H 


3H/3u  <  0 


I/3u 


>  f) 


mm 


max 


u 


Figure  4. 


slope  -  (-£  -1) 
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lf  on/du  -  z  is  less  than  zero,  the  optimal 
control  is  u*  =  u  ■ 

mm* 

3.  at  the  time  point  x  at  which  3H/9u  =  z  becomt 
zero,  the  optimal  control  u*  is  switched  from 
maximum  to  minimum. 


es 


The  time  point  x  at  which  the  control  variable  u  is 
switched  from  maximum  to  minimum  is  called  switchover  point, 
and  the  associated  control  bang-bang.   The  trajectory  of  u  is 
shown  in  Figure  4.5.   In  traffic  terms,  this  control  implies 
that  the  effective  green  time  g±    is  maximum  in  the  interval 
[0,  x]  and  minimum  in  the  remaining  interval  [x,  t  ].   Con- 
versely, since  the  sum  of  the  green  times  is  constant,  g9  is 
minimum  in  the  interval  [0,  xl  and  maximum  in  the  interval 
fT»  t±h       Xt  is  important  to  note  that  the  possibility  that 
z  does  not  change  sign  during  the  entire  interval  [0 ,  t  ] 
should  not  be  excluded.   In  this  case,  u*  is  either  maximum 
or  minimum,  depending  on  the  sign  of  z,  for  the  entire  inter- 
val [o,  t1]. 

It  is  clear  that  for  the  computation  of  the  switchover 
time,  the  final  time  and  the  minimum  delay  knowledge  of  the 
demand  curves  is  required.  If  the  demand  curves  are  linear 
functions  of  time  of  the  form 

Qi  =  Ai  +  V  i  -  1,2  (4.1.59) 

analytical    solutions    can   be    obtained   as    indicated   in   section 
2.2.       This    assumption,    however,    implies    that    the    arrival 
rates    are    constant    and  not    varying   with    time    as    it   happens 
in    reality.       Furthermore,    in    the    preceding    analysis,    no 


52 


u 
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Figure  4 . 5 

consideration  was  given  to  the  maximum  or  minimum  size  of  the 
queues.   Therefore  the  solution  (even  for  the  linear  demand 
case)  may  allow  the  queues  to  become  negative  before  the  end- 
ing- of  the  overs aturation  period.   A  queue  is  said  to  be 
negative  on  a  particular  approach  when  the  light  is  green  and 
there  is  not  sufficient  demand.   This  situation  should  never 
be  allowed  before  the  ending  of  the  oversaturation  period. 
In  addition  to  the  lower  bound,  upper  bound  constraints  must 
be  placed  on  the  queues  so  that  upstream  intersections  are 
not  blocked.   The  theoretical  considerations  and  the  solution 
to  this  more  general  problem  are  presented  in  the  following 
sections . 


4.2.   Op t i m al  Control  with  S tate  Var I a b  1 . e  Cons traints 


In  the  previous  analysis  constraints  we  re  only  placed  en 
the  decision  variable  u(t) ,   Attention  is  now  given  to  the 
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more    general   problem   in   which   upper    and   lower  bounds    are 
placed   on    the    state    variables     (queues).      As    mentioned  earlier, 
the    queues    must    always    be   nonnegative ,    otherwise    green    time 
is    wasted.      On   the    other  hand,    if  the    queues    are    allowed   to 
grow  with    no    restrictions,    upstream   intersections    may  be 
blocked.       Consequently,    congestion   may    spread   to    adjacent 
intersections    even   though    the    demand  may  be    lower   than   the 
capacity    there.       In    fact,    the    effectiveness    of  any    control 
scheme    lies    in   its    ability   to    limit    the   queues    to   some 
desired   level. 

This    analysis   will    show   that  when  both    queues    reach    the 
upper  bounds    simultaneously,    the    cycle    length   must  be    free    to 
vary.       Thus,    upper    and   lower  bounds    on    the    cycle    length    must 
be    established. 

By    considering   queue    length    constraints,    the    problem   is 
placed    on    a   more    realistic   basis.       The   new    formulation    follows. 

Problem:      Minimize    the    delay    function 

Mm  XQCtn)    =   Max  F   -    -sq^i)    =    ~ f      (x,+x?)dt  (4.2.1) 

u(t),t1  u(t),t1  o 

subject    to 


ax, 

dt 
dt ' 


x    +  x 

"1    ^2 


£'-,    =    q-jCt)  -u 


(4.2.2) 
(4.2.3) 


dx. 


tit: 


f-7      =     C],   -S„  (1-  — )  +-—     LI 

I  -2        2   •        C      S  , 


(4.2. 


with    in.it 


and    final    conditions 


S4 


>^(0)    -    x1(t1)    -    0 


x?(0)    =    x0(t 


->  \  <•  i ,' 

L  1 


x0(0)    -    0 


(4.2.5) 


(4.2.6; 


(4.2.7) 


u   is    an    admissible    control    in    the    interval 

s,g(1)  ■  s   od) 

-i|^  =    u   .      <   u  <    ..lg^x  =   u 

c  mm   —       —        c  max 

and  the  additional  state  variable  constraints 


(4.2.8) 


x. 


a, 


x      >    0 


x, 


upper   bound    for   queue    1 
upper  bound   for   queue    2 


(4.2.9) 
(4.2.10) 
(4.2.11) 
(4.2.12) 


Optimal  control  theory  states  that  if  the  constraints 


s  tor 


any  time  interval  are  strictly  inequality  constraints,  they 
do  not  place  any  restriction  on  the  variation  of  the  optimal 
control.   One  only  needs  to  ash  what  changes  are  required  when 
Eqs.  4.2.9  through  4.2.12  become  equality  constraints  for  a 
finite  period  of  time.   That  is,  the  equalities  present  a 
problem  when  they  hold  for  a  finite  period  of  time.   However, 
if  they  hold  only  for  one  time  point  they  pose  no  problem, 
because  the  control  variable  is  not  affected.   Therefore, 
when  the  bounds  tend  to  be  exceeded  for  some  time  interval, 


Eqs,  4.2.9  through  4.2.12  become  equality  constraints 


,    J-  •  -  •  3 


al 

or 

■:>1 

X  -  Ct          ~ 

XI  1 

0 

a? 

OI 

S7      = 

x?-a?    - 

0 

(4.2.13) 
(4.2.14) 


x,    -    0      or      S-   =    x,  -0    =   x, 

1  3  11 


x0 


0      or      S.    =   x?-Q 


x. 


(4.2.15) 
(4.2.16) 


To    simplify    the    analysis,    first    consider   only   equality    con- 
straint   4.2.15.       Afterwards,    extension    to    include    the    remain- 
ins    constraints    is    simple. 


Consider   an    interval    [t 


(1)  A2\ 


]  during  which  the  opti 


mal  trajectory  of  x,  lies  along  the  constraint  (see  Figure 
4.6),   Since  Eq.  4.4.13  holds  as  an  identity,  i.e.,  it  is 

true  independently  of  the  value  of  t  in  the  interval  [t^   , 

f  2 1 

t         ],    it    can   be    differentiated  with    respect    to    time    to    obta: 


but 


dS. 


at 


dx- 
dtT 


dx. 
aT 


qru 


(4.2.17) 


(4.2.18) 


and    so 


q,  -u   =    0 


tCD<t<t(2) 


(4. 2.19) 


Therefore,    Eq.    4.2.19    must   be    satisfied    for   every    time    in    the 
interval    [tl~J,    t ^    J ]   where    the   equality    constraint   4.2.15 
holds.       In    addition,    it    is    required   that    (see    Figure    4.6) 


SjttW)  -  ,  ctW 


)  -  a  - 


(4.2.20) 


That  is,  when  Eq.  4.2.20  is  valid,  Eq.  4.2.19  or  its  corre- 
sponding Eq.  4.2.13 'is  valid  for  the  entire  time  period  [t^   ■ 


(2) 


].       Therefore,    Eqs,    4.2.19    and    4.2.20    are    equivalent    to 
4.2,13. 


i>0 


X. 


t 


CD 


(2^ 


Figure    4.6 


For    a   problem  having    equality    constraints    such    as    4.2.19 
and   4.2.20,    the    differential    equation    for    the    adjoint    vari- 
able   A,    is    given   by 
1  &  J 

2       ('. 


dX. 


i  =  0 


d  r 


x        3fj     r3Rx1  -1    3RX 


3  x ,  9  u       [  3  u  J 


dX- 


X. 
J 


(4.2.21) 


Furthermore,    at    time    t    =    t 


(1) 


:he  adjoint  variable  X1  should 


satisfy  the  fallowing  condition: 


(4.2.22) 


and   since    3S-/3X,    =    1    (see    Eq.    4.2.20),    it    follows    that 


\1(t(1)-)     -    Al(t^  +  )    ♦    y 


(4.2.2  3) 


where  A,  is  a  constant  to  assure  the  discontinuity  of  the 
trajectory  of  A,  in  the  vicinity  of  t'  ^  (see  Figure  4.7), 
This  condition  is  unique  if  it  is  required  that  X      be  con- 


tinuous 


5  7 

Similar  analysis  applies  if  equality  constraint  4.2.14 
holds  and  equations  such  as  4.2.20  and  4.2.22  need  to  be 
derived.  -  . 

Consider  an  interval  [t^   ,  t ^  J]  during  which  the  opti 
mal  trajectory  x~  lies  along  the  constraint  4.2.14  (see  Fig- 
ure 4.8).   Since  Eq.  4.2.14  holds  as  an  identity  for  every 
time  point  in  the  interval  [t^,  t  *-  ^  ]  ,    it  can  be  differen- 
tiated with  respect  to  time  to  get 


dS  „    dx? 

a"t~  " 


dt 


=  0 


DUG 


dt 

therefore 


dx?  ,   s? 

'  *  q  -s  (l-|)+?£  u 

L        £  C   S1 


R7 


q2-s2(i-!)+Jfu  =  ° 


t(3)<t<t(4) 


(4.2.24) 


(4.2.25) 


(4.2.26) 
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Figure  4.7 
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Figure    4. 


Thus,    Eq ,    4.2,26    must  be    satisfied    for   every    time    point    in 
the    interval    [t-       ,    tL    ; ]    where    the    equality    constraint 
4.2,14   holds.       In    addition,    it    is    required   that 


S^t^)    =    x2(t^)-a. 


0 


(4.2.2  7) 


That  is  when  Eq.  4,2.2  7  is  valid,  Eq.  4,2.26  or  its  corre- 
sponding Eq.  4.2.14  is  valid  for- the  entire  time  period  [t^ 

f'4 1 
t l  •' ]  .   Therefore,  Eqs  .  4.2.26  and  4.2.2  7  are  equivalent  to 

Eq.  4.2.14. 

Because  Eqs,  4.2.26  and  4.2.27  are  equality  constraints, 

the  differential  equation  for  the  adjoint  variable  X-,  is 

given  by 


dX, 


a~t 


1-  -  T. 


3±„ 


3  f .  (dR^-\.   -1  3  R, 


3u    Du 


"2  J 


] 


Also,  at  the  point  t  =  t^  '    the  adjoint  variable  X-  must- 
satisfy  the  following  condition: 


(4.2.2  8) 
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M' 


(3) 


(3) 


3S. 


3     -    *2Ct^    )    +    U2    3-±.    A?(t^^)    +    u       (4.2.29) 


rt^) 


where    u2    is    a   constant    assuring   the    discontinuity   of   A?    at 
the    vicinity    of   t -    J  . 

Equations    4.2.21    and   4.2.23   must    be    satisfied   only   when 
constraint    4.2.9    is    imposed.      Equations    4.2.2  8    and   4.2.29 
must  be    satisfied   only  when    constraint   4.2.10    is    imposed. 

The    differential    equations    4.2.21    and   4.2.28    require 
further   expansion.       Equation    4.2.21   yields 


2t  ~TiT  du  [      3u        j  dxl 


u) 


A0 


f3[q-L(t)-u]  3[q1(t)-u]     (3  (q-[  -u)  )  -  1    3  (qn  -  u) 

j  3x^  '  du         ~ 


dU 


h 


f^c^Ctj-u]  3[q2(t)-s2Cl-|)+ii  u] 


3x- 


3u 


fH^-ujyl    3(q1-u)) 


•  u 


[o-o(-i)  "  oj-An  -   [o-C-D(-i)"1  o] 


1    m.i 


co-(~-)(-ir1-co)]-x2 


=    °  (4.2.30) 

Therefore    \-}  (t)    is    constant    in    the    time    interval  [t^1^,    t^] 

Similarly,    from    the    differential    equation    4.2.2  8  it    follows 
that 


6  0 


dA 


/  ■  -[o-o(--i)'1  o]a.0       [o-c-DC^-)"1  o]a1 


'1 

[O-(^)'  (--)'"    0]A,    =    0 

1        1  " z 


'1 


(4.2.31) 


Therefore    A„(t)    is    also    constant    for    the    time    interval    [t 

(4'1  , 
t         ]  . 


(3) 


The   previous    analysis    is    also   valid   for   the    lower  bound 
constraints    4.2.11    and   4.2.12.       In    fact,    by    inspection    of 
Eqs.    4.2.13    and   4.2.15    it    is    seen    that    S ^    can  be    obtained    from 
Eq.    4.2.13  by    letting    a,    equal    to    zero.      Thus,    the    results 
obtained   for   the    upper  bound   constraint    4.2.9    are    also    appli- 
cable   to    the    lower  bound   constraint    4.2.11.      Similar   conclu- 
sions   can  be    drawn    for   the    lower  bound   constraint    4.2.12. 

In    summary,    the    preceding    analysis    indicates    that 

1.  When    constraints    x-j_    <_  cti    or   xj    >    0    are 

imposed 

a.  the  optimal  control  u*  is  affected  only 
when  the  constraints  are  at  equality  for 
some  time  interval  [t(l),  t(2)]. 

b.  during  this  interval  Ax  (t)  is  constant 
and  is  given  by  Eq.  4.2.2  3. 

c.  from  Eq.  4..  2.19  it  follows  that  when  the 
constraints  are  at  equality 

u*  =  q1  (4.2. 32) 

2,  When  constraints  x?  <  a?  or  x9  >  0  are 
imp os  ed 

a.  the  optimal  control  u*  is  affected  only 
when  the  constraints  are  at  equality  for 
some  time  interval  [t(3),  tC^3j. 

b.  during  this  interval  A2  (t)  is  constant 
and  is  given  by  Eq.  4.2.29. 

c.  from  Eq.  4.2.26  it  follows  that  when  the 
constraints  are  at  equality 

u;-  -  [s9(l-~0-q,]  —  (4.2.33) 

C      -L  b? 
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If  two  constraints  are  of  equality  simultaneously,  I.e. 
if  it  is  required  to  satisfy  4.2.9  and  4.2.10  simultaneously 
and   the    cycle    length   Is    constant,    the    problem  may  be    impos- 


sible.      This    is   because    In    th: 


as e    Eqs .    4.2.32    and   4.2.33 


rasp 


trust    be    satisfied   simultaneously,    I.e., 

s. 


U" 


q 


L. 


1 


LS?(l-~)-q?] 


1 

cJ    H2-!    sT 


(4.2. 34] 


or,    solving    for    c, 


1 


qj  q7 


2 


(4.2.35) 


•  j 


if  the  given  constant  value  of  the  cycle  length  satisfies  the 
above  relationship,  a  solution  exists  and  both  constraints  on 
x~i  an-d  x?  can  be  imposed.  If  not,  a  solution  does  not  exist 
and  the  constraints  will  be  violated.  Equation  4.2.35  simply 
implies  that  a  solution  exists  only  if  the  signal  is  not 
oversaturated  during  the  period  at  which  both  constraints  are 
at    equality. 

In    order   to    circumvent    this    difficulty,    the    cycle    length 
must  be    free    to    vary    so    that    4.2.35    is    satisfied.       In   this 

case,    a  maximum   and   a  minimum   value    (c  and   c    .    1    for   thp 

k  max      miru 

cycle  length  need  to  be  established.   If  only  x   is  on  the 

equals  zero  or  if  x.  equals 


ounda r i e 


tha 


s  ,  2  j:  eit  ner 


tnen  considering 


i-  x 


1  ■  I 


!C  V.  b  .-> 


ou  con 
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must  change  correspondingly  so  that  4.2.36  is  satisfied. 
Similarly,  if  only  x«  is  on  the  boundaries,  then  from  4.2.35 

t 

s2(L+gl) 

C sT^ (4.2.37) 

b2  l2 

an-"  since  c,  s,,,  and  L  are  assumed  constant,  g,  must  change 
sc   hat  4.2.37  is  satisfied.   From  4.2.37  it  is  seen  that  if 
s2  is  less  than  or  equal  to  q? ,  a  solution  does  not  exist. 
This  condition  simply  implies  that  the  input  flow  rate  is 
higher  than  the  saturation  flow  at  the  second  approach.-  Conse 
quently,  congestion  cannot  be  avoided  even  by  providing  con- 
tinuous green.   Therefore,  it  is  possible  to  impose  only  one 
constraint  and  keep  the  cycle  length  constant;  however,  for 
more  than  one  constraint,  it  is  necessary  to  have  variable 
cycle  lengths.   Clearly,  when  constraints  are  imposed,  several 
switch  points  may  exist.   The  number  of  the  switch  points  is 
a  function  of  the  demand  curves. 

It  is  emphasized  that  in  the  preceding  analysis,  no 
specific  assumptions  have  been  made  concerning  the  demand. 
Thus,  the  theory  is  general  and  applicable  to  any  demand  func- 
tion.  Furthermore,  it  must  be  noticed  that  control  with  upper 
bound  constraints  prevents  upstream  intersection  blockage  but 
results  in  higher  total  delay.   When  minimization  of  the 
total  delay  is  the  only  objective  of  the  control,  upper  bound 
constraints  should  not  be  placed.   Solutions  of  both  the 
unconstrained  and  the  constrained  problems  are  necessary  at 
th  i  s  po'i  lit . 


4.3,   Solution,  to  the  Unconstrained  Problem 

The  problem  of  finding  the  optimal  control  u*  is ,  in 
general,  not  an  easy  one.   Only  in  very  simple  systems  is  it 
possible  to  obtain  explicit  solutions  for  u*.   The  situation 
becomes  more  complex  when  nonlinearities  are  introduced,  and 
in  most  practical  cases  one  must  be  content  with  a  numerical 
solution  generated  by  a  digital  computer.   It  is  then  neces- 
sary to  develop  an  algorithm  to  calculate  the  switch  points 
(if  they  exist),  the  final  time  and  the  minimum  delay.   In 
this  section  the  minimization  problem  with,  only  lower  bound 
constraints  will  be  considered.   When  upper  bound  constraints 
are  imposed,  the  resulting  delays  are  higher  and  the  control 
becomes  more  complex.   This  case  Is  treated  In  the  next  section, 
The  algorithm  for  the  unconstrained  problem  is  as  follows: 


STEP  1.    Assume  values  for  k-,  and  k? 


The  unknown  integration  constants  k-,  and  k?  of  Eqs 


4.1.48  and  4.1.49  are  needed  for  the  computation  of  th 


e 


adjoint   variables    A,    and   A„.      Based  on   the   estimated  values 
of  k,    and  k~    an    initial   solution    can  be    found.      The    optimal 


solution  will   be    computed  by    Iterating    on   k1    and  k 


2 


STEP    2.         Set    t1    =    0,    xn(tx)    -    0,    x,  (t1)    -    0,    x^ft1)    -    0 


an  d  1   =    0 . 


The    initial    conditions    of    the    state    variables    x,,x?,    i. 
:he    queue    lengths    and   the    total    delay    x„    are    zero    as    stated 


iii    the    formulation    of   the   problem 
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STEP    3.         Put    i   =   i+1    ,      t*-1-'    -    t^+At      and 


AoCt1)    =    -1 
A^t1)    -    t(: 
X0(tX)    =    t(l)+k. 


X^t1)   =  t^+k1 


This  step  performs  numerical  Integration  of  the  adjoint 
variables  (Eqs .  4.1.40  through  4.1.42). 

STEP  4.    Find  the  value  of  z  at  t1  from  Eq.  4.1,52,  i.e., 

i  -  c^.-  Dt(i)  ♦  (k2  !i.  kp. 

STEP    5.        Examine    the   sign   of   z. 

If   z    >    0  ,    ■*•  u*    =    u 

'  max 

I  £   z   <    0 ,   ■+   u':;    =    u 

—      '  hi  in 

If   at    t'-~    -  ;       z    >    0    and   at    tK    }      z    <    0,    set    t    =    t1-' 

ks    Indicated   in   section    4.1,    switchover   point    occurs 
when   z    changes    sign,    and   the    optimal   value    of   u   at   each    time 
point    is    determined   from   the   sign   of   z. 

STEP    6.         Determine    the    current    state    of   the    system. 
j  X1(tCi));»    x^t11"13)    +    [qi(tCi))-u*]At 

*?(t(l))    -    x    (t(i"1})    +     [q2Ct(i))-S2(l-fe  +  ^-  u*]At 

x0(t(i))    =   x0(t(i_1))    +    [x1(tCi})+x2rt(l))]At. 

This  step  performs  numerical  integration  of  the  state 
equations  4.2.2,  4.2.3  and  4.2.4.   if  any  of  the  state  vari- 
ables are  negative,  steps  similar  to  steps  2a,  5a  and  6a  of 
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the  constrained  algorithm  (next  section)  must  be  followed  for 
the  calculation  of  the  adjoint  variables  and  the  control  vari- 
able u. 

STEP  7.    Examine  the  value  of  H  at  time  t ^ ,  i.e., 

f  i   1 

Is  H(tv  J)    =    zu*+w  =  0? 

If  "yes"  go  to  Step  8. 

It  "no"  put  t   =  t  +At  and  return  to  Step  3. 

In  this  step  the  value  of  the  Hamiltonian  function  Is 
checked  to  determine  whether  or  not  it  is  constant  and  equal 

to  zero  along  the  entire  optimal  trajectory.   If  H  Is  zero  at 

(  i "!  t  1  ~\ 

but    not    at   t         ,    the    assumed  k±    and  k?    are  wrong    and  new 

values    must  be    given.       Conversely,    if   H    Is    zero    for    the 
entire    interval    [t^,    t^],    the   k±    and  k£    values    are    correct 
Equation    4.1.51    is    used    to    compute    H. 


STEP    8.         Examine    the   state    of   the    system  at    t^1^ 
Is    x1(t^1^)    *»    0    and  x?(t^)    =    0? 


,  i.e.., 


If  "no"  and  H(t(rj)  =  o,  return  to  Step  3 


"^ ,-.  1 1 


>r     HCt^)    j   0,   put    t,    »    t^  , 


no"    or      H(.tv    J)    f    0,    put    t1    =    t^,    total 
delay   =    x0(t^1J),    assume   new   values    for   kw    and  k? 
and    return    to    Step    2, 

If   "yes"    and   H(tCl))    -    0,    END.       The    total    delay 

f  i  1  ( '  ~\ 

is    x0(tl    J)    and   the    final    time    equals    tlLJ. 


This    step    assures    that    the    optimal    values    of   k,     and  k„ 

i-       2 

have  been  found  and  terminates  the  iterative  procedure.   If 
]:l    and  k2  are  not  the  optimal,  new  values  need  to  be  assumed 
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and  the  process  is  repeated.   The  new  values  of  k,  and  k? , 

th 
however,  will  not  be  random  in  the  2nd,  3rd,  ...,  n  "  itera- 
tion, but  they  will  be  chosen  by  an  optimization  routine. 
The  routine  will  minimize  the  objective  function 

7  ? 


I 


X9  \t~   J 


Therefore,  this  step  is  the  responsibility  of  the  optimization 
subroutine.   The  reason  for  using  the  sum  of  squares  of  the 

queues  at  the  final  time  in  the  objective  function  is  due  to 

2  1 

the  fact  that  this  function  is  quadratic.   Powell   has  shown 

that  such  functions  result  in  faster  convergence. 

It  should  be  noticed  that  the  above  algorithm  ends  only 
when  the  conditions  of  Pontryagin ' s  maximum  principle  have 
been  satisfied.   That  is,  the  algorithm  assures  that  the 
Hamiltonian  function  is  constant  and  equal  to  zero  along  the 
optimal  trajectory;  furthermore,  H  is  maximized  with  respect 
to  u  at  each  time  point.   The  initial  and  final  conditions 
are  also  satisfied  since  the  queues  at  the  beginning  and 
ending  of  the  control  period  are  zero  (Steps  2  and  8).   Fig- 
ure 4.9  illustrates  the  algorithm  for  further  clarification. 


4.4.   Solution  to  the  Constrained  Problem 

In  the  previously  developed  algorithm  no  upper  bounds 
are  placed  on  the  state  variables  x,  and  x-  (queues).   There- 
fore, the  algorithm  is  not  applicable  for  cases  where  minimi- 
zation of  the  total  delay  subject  to  queue  length  constraints 
is  the  objective  of  the  control.   Constraints  can  be  placed 
cither  on  one  or  both  queues;  in  the  latter  case  the  control' 
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is  more  complex  because  the  queues  may  be  at.  the  upper  bound 
simultaneously.   In  the  development  of  the  algorithm,  the 
necessary  conditions  for  optimal  solution  derived  in  section 
4.2  will  be  used.   Since  the  problem  of  constraining  one 
queue  only  is  simpler,  it  will  be  considered  first. 

In  the  following  algorithm  It  is  assumed  that  constraints 
are  imposed  only  on  the  first  queue,  i.e., 

0  <  x,  (t)  <_  a. 

If  constraints  arc  Imposed  only  on  the  second  queue,  the 
algorithm  still  applies  with  some  minor  modifications.   These 
modifications  wil-1  also  be  presented.   The  new  algorithm  is 
as  fol lows : 


6  8 


STEP  1, 
STEP  2 . 


Assume  values  for  kj_  and  k?  . 


be" 


-        0,         Xg{t  j 


0,    x,(tCi]) 


x?  (t^)    =    0    and   i 


0 


These    ti\ro   steps    are    the    sane    as    the    ones    of   the    previous 
algorithm. 


<J  x  lli  t  ij    cl  i 


Cb° 


iecK    the    magnitude    of   x. 


Ci) 


>(i) 


If  x1(t^J)    >    c^    or   xx(t^J)    £  0   put   u» 


q- 


a-,    or  x,    =    0    and  if   u    .       <    u*    <    u 
1  2  mm   —  —     max 


go   to   Step    3a,      Otherwise,    the   problem  is 
impossib le . 

That    is,   when   the    constraints    placed   on    xy    are    active,    the 

optimal    value    of   u   is    not    determined   from    z   but    rather    from 

Eq„     4.2.32.,       If   the    optimal    value    of   u   lies    outside    of    the 

bounds    specified   for  u,    solution    does   not   exist  because    the 

constraints    placed   on    u   are    violated.      A  suboptimai   policy 

would  be    to   use    either   u  when   u*    >    u         ,    or  u    -      when 

max  max'  mm 


u"    <    u 


mm 


STEP    3, 


Put 


1  +  1,    t 


:d  =  t(i)+At 


At    and 


1 


\vCt(i:))   -  t(i3+k 
x2(t(i))  =  t^+k 

and   go    to    Step    4. 


m: 


;ep    is    the    same    as    j,n    the    previous    algorithm   and   is 


Followed   only   when   x,    is    internal    to    the    constraints 
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otherwise    it   is   bypassed. 
STEP    3a.       Put    i    -    i+1, 

and   go    to    Step    6. 

This  step  is  followed  only  when  any  of  the  constraints  placed 
at  x±  are  at  equality;  the  value  of  u*  has  been  determined  in 
Step  2a.   The  value  of  A,  is  maintained  constant. 

STEP  4.    Compute  z. 

1  "  sl       x 

STEP  5.    Examine  the  sign  of  z. 

If  z   >   0  +  u*   =    u 

max 

lfz<0+u*=u.. 

—  mm 

If    at    t^1]       z    >    0    and   at    t^       z    <    0 ,    set    t   -    t^ 

These    steps    are    the    same    as    in    the   previous    algorithms    and 
they    are   bypassed  when   Xj    is    either   at    the    upper   or   at   the 


lower  bo un 


A 


STEP  6.   Determine  the  current  state  of  the  system. 


^(j-)'i    _    v     r+(i-l)-»     .      r        ,-.('i)^  n     L,.S2 

j  ~  X?^L  j  T   [q?U*  0-s2Ci--)+~  u*]&t 


c 

i. 


VtClb  -  xoct"-")  *  tx^t^h^ct^h 
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This    step    remains    unchanged   and   it   is    always    followed. 


STEP   6a.      Check   the   magnitude    of   x. 


If  x,    >    a,    or  x,    <    0   put 
(1)    _   ,(i) 


t    -  L 


and 


(I) 


^(t^O    =    A^t^)^- 


This    step    satisfies    the    jump    condition    for    A,    at    t^    •*  .       In 


addition ,    X      is    maintained   constant    in   the    interval    [t 
tv      j .       hquation    4.2.2  3    is    used    for   the    computation   of 


CD 


(i) 


XjCt^). 


?EP  7.    Examine  the  value  of  H  at  time  t'-1-' 


is  h  =  v)(xi+x2;)+xi[ciru]+A2[ci2"52cl-c1)+r1  ll]  =  0? 

If  "yes"  ?o  to  Step  8. 


it   "no"  put  t 


:(i)+At  a 


nd  return  to  Step  2a. 


The  Hamiltonian  function  in  this  step  is  computed  from  Eq. 

r  li      r 9 1 

4.1.39    since    A,    is    constant    in    the    interval    [tv       ,    tK^J]    and 
Eq.    4.1.51    does    not    apply. 


STEP  8 


Examine  the  state  of  the  system  at  t ^  ,  i 
Is  x,  (t^h    =  0  and  x2  (t^)  =   0? 


fll 

and   H(t.      J)    =    0,    return    to    Step    3 

If   "no"    or      H(t^)    f    0,    put    t. 


t^  ,    total 


CD 


delay    =    x    (t^    J )  ,    assume    new    values    for  k,    and  k? 

and  return  to  Step  2, 

if    "yes"    and    BCt^}    -    0,    END.       The    total    delay 


X0  ^ 


•  .)  and  the  linai  rime  equals  tv 
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This    step    is    the    same    as    in    the    previous    algorithm. 

When    this    algorithm   ends,    it   has    satisfied   the    necessary 
conditions    of    the    maximum   principle,    since    H    is    constant    and 
equal    to    zero.      The   Hamiltonian    function  has    also  been  maxi- 
mized  at    each    time   point.      The    constraints    are   not    violated 
since    u*    is    determined    from  Eq.    4.2.32.       Furthermore,    X.    main- 
tains   a   constant   value    during;   the   period   at  which   the    con- 
stramt    is    at   equality,    and  the    jump    condition   of   section   4.2 
is    satisfied. 

When   only    the    second  queue    is    constrained,    the    algorithm 
still    applies   but    Steps    2a,    3a   and   6a  need  to  be   modified   as 
follows . 


STEP    2  a.       Check    the   magnitude    of   x9 , 

s. 

1j  -i  1      L 


If  x2    >    a2    or   x?    <_  0,    put   u*    =    [s,  (1--)  -q,  ]  — 


C       z  Js 


If   Umin    i  U*    i  Umax   ^ut    X2    =    a2    or   X2    =    ° 
and   go    to    Step    3a.       Otherwise,    the   problem  is 

impossib le . 


STEP    3a.      Put    i         i+1 

■o 


.(t(iJ)    =    0 


and   go    to   Step   6 . 


STEP    6a.       Chech    the    magnitude    o  £   X-, 


4-    K. 


r  i  'i         r 


u  J 


(t(i)) 


A7(tf 


or   x0    <    0   put 

d.u  CI 
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If  constraints  are  imposed  on  both  queues  and  the  con- 
straints are  at  equality  simultaneously,  the  cycle  length  must 
be  free  to  vary.   During  this,  period  the.  following  steps  must 
be  followed. 


STEP  2a.   Check  the  magnitude  of  x,  and  x9. 


L, 


If    x,    >    a,     and   xn    >    an    put   u*    =    q,    =    [s~  (1~— ) -q_  ] — 

1—1  2    —     2    r  ll  2  -      c       L2Js_ 


If   u 


mm   —  '  "max  c~      ~^1        """1    **""'  "2        "2 

and   go    to    Step    3a.       Otherwise    the   problem   Is 

impossible . 

If   only   x,    >    a,    follow   the    algorithm   developed   for 

constraining    the    first    queue. 

If   only   x~    >    a?    follow   the    algorithm   developed 

for   constraining    the    second   queue. 


STEP    3a.       Put    i    =    i+1 

x0Ct^D   - 


x1Ct(i)3  =  x.Ct^'1^ 


l 
i 


x2(t(i})  -  x^1"1^ 

and   go   to   Step   6. 


STEP   6a. 


Check    the    magnitude    of   x,     and   x„ 


If   x 


1 


'1 


put    \.  (tUj)    =    X,  (t 


1^        J  '  "1 


If   x?    >    a,.,    put    A-  (t 


Ci), 


f   x,    > 


and   x- 


=  x2( 

put    c* 


t(i)l+ 


J   '  Vn 


l-LCq1/s1)+(.q2/s2T 


I  f    c    -       <    c*    <    c 

mi  n    — 


the    problem   Is 
m  ax  L 

possible.       Otherwise    the    problem  has    no    solution. 
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It  is  possible  that  during  the  control  period  the  con- 
straints are  not  at  equality  simultaneously.   In  this  case, 
the  cycle  length  can  be  kept,  constant  for  the  entire  interval 
[0,  t1j. 

4,5.   Some  Computational  Aspects 

The  computation  of  the  adjoint  variables  A,  (t)  and  A7  (t) 
for  the  constrained  problem  requires  further  development.   In 
section  4.2  it  has  been  shown  that  \A£)    and  Xn  (t)  are  con- 
stant when  the  constraints  are  at  equality,  and  that  as  soon 
as  the  bounds  are  reached  there  is  a  jump  condition  that  the 
adjoint  variables  must  satisfy.   The  constant  value  of  the 
adjoint  variables  given  by  Bqs .  4.2.2  3  and  4.2.29  can  be  com- 
puted only  If  the  parameters  y   and  y„  are  known.   Since  the 
derivation  of  u,  and  y.?  is  not  apparent,  it  is  presented  in 
this  section. 

A  closed  form  solution  for  u,  can  be  found  from  Eq. 
4.2.23  and  Figures  4.6  and  4.7.   At  time  t  *•  '  it  is  required 
that  the  adjoint  variable  A,  be  continuous,  i.e., 


Mtt2>")  -  Mt(2)  +  ) 


(4.5.1) 


and  since  A,  is  constant  in  the  Interval  [t^  ■ ',  t-2-1},    it 


'1 

follows  that 


^(t(1)+) 


Xl(t 


(2) 


(4.5 


Furthermore,  Eq.  4,1.48  at  times  t 


(2) 


Uld  t  '  J 


y  i  elds 


However,  from  Eq.  4.2.2  3 


or,  substituting  A.,  (tv-'L-'  )  into  Eq .  4.5.5 


^-1  int. 


thus,  from  Eqs .  4.5.2  and  4.5.6, 


and,  finally,  from  Eqs.  4.5.3  and  4.5.7 
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,    f  2 1  f  2 1 


and 


VtO>)  -  tCD.i 


1 


(4.5.3) 


(4.5.4) 


A1(t(1)+)+u1 


"1 


1 


(4.5.5) 


V(I),i  -  tcl}-Vi 


(4.5.6) 


Mt(2b 


t         +kx    p2 


(4.5.7) 


t^2j+k1    =   t^+k.-^ 


(4.5.8) 


u1   -    t 


(D„t(2)     <    Q 


'4.5.9) 


Similarly,    y9     (considering   Eqs.    4.1.49    and   4.2.29)    Is    given  b' 


u?   .  t^-t^   <  0 


4.5.10) 


Thus,    the    final    form   of   Eqs.    4.2.2  3    and   4.2.29    becomes 


)     ft^^l 
A1(t 


xltt")-) 


t(D         t(2) 


(4.5.11) 


an  d 


X7(t 


(3) 


J    +    t 


(4) 


(4.5.12) 
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Faster    convergence    and    a  more    accurate    solution    can   be 
obtained  by    estimating   the    parameters    k-,    and  k?   which    are 
required   in    the    first    step    of   the    previous    algorithms.       Since 
however,    k,    and  k«   have   no   physical   meaning,    it   is    difficult 
to  be    estimated.      Nonetheless,    if   estimations    of    r    and   t1    are 
made,   k,    and  k~    can  be    derived   from  Eqs .    4.1.50    and  4.1.52   by 
setting    z    equal    to    zero    at   time    x    and  H  equal   to    zero    at   time 
t, .       In   this    manner,    a  system   of   two   equations   with   two 
unknowns,    k-,    and  k?  ,    is    obtained  which    can  be    solved   for  k, 
and  k„.       In    fact,    letting   Eq.    4.1.52    equal    zero    at   t   =    t    the 
following   is    obtained: 

s .  s 

(—-  -    1)      +    (k9    -1  -    k   )    =    0  (4.5.13) 

1  l   sl  l 

and   from  Eq.    4.1.50    at    t    =    t1 

s2  S2  L 

(g l)txu   +    (1<2    —   -kx)     -     [q1  +  q2-s2(l--)]t1    -    x1 

-    x2    +   kiqi    +   k2[q2-s2(l-|)]    =    0  (4.5.14) 


The    solution    of    the    above    system    (Eqs.    4.5.13    and    4.5.14)    is 

(4.5.15) 


ocu+  (a/f ) y - 6 1 ,  -  ( f - 1)  t ,  u 


"1    ~  VCY/fJ 

k2    =    (k1-a)« (1/f)  (4.5.16) 

a  =    [  ( s ,,  /  s  -, )  - 1  ]  t      an  d     f  =   s  -  /  s  n 

£  J.  £  X 

Y    =    q?-s? (1-L/c) 

5    =    qi+q2-S2(l-L/c) 

u   -    u, 


mxn 

1  nu     y  a  t  a  ~      a  t      +■      -~      +■ 


q.  ,q»    =    the    flow    rates    at    t    =    t 
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A  final  remark  is  in  order  before  concluding  this  sec- 
:ion.   From  the  relationship 


s       -        s? 
z  =  (—-  -Dt1  +  (k?  -± 
1  1 


k,3 


(4.5.17) 


and   since    it   was    assumed   that    s,    is    greater   than   s,,    it 

JL  6 

follows    that    the    first   term   is    always   negative.      Therefore 
z    changes    sign   onlv    if 


s  s 

:,    —  -   k,    is    >0    ->  k0    >   k.,    -± 

2    s  1  2  1s 


(4.5.18) 


Otherwise,  z  is  always  negative  and  switch  point  does  not 
exist.   When  s,  is  equal  to  s?,  switch  point  does  not  exist 
since  z  will  always  have  the  sign  of  the  second  term. 


4,6.   The  Optimum  Cycle  Length 

The  cycle  length  c  is  a  parameter  which  remains  constant 

throughout  the  entire  peak  period.   The  total  intersection 

delay  is  a  function  of  the  cycle ' length ,  and  the  problem  is 

to  find  the  optimal  value  of  c  that  minimizes  the  total  delay. 

For  practical  reasons  the  cycle  length  has  upper  and  lower 

bounds  so  that  c  -   <  c  <  c    .   Short  cycles  create  excessive 

mm   —       —     max 

lost   times   which,    in   turn,    cause    extreme    delays.       Long   cycles 
may  be    ignored  by    drivers   who    can   possibly   think    that   the 
s  i  gn  al    h  as    failed. 

In   general,    experience    indicates    that    for  overs  at ur a ted 
intersections    and    for    single    setting    of    the    signal,    long 
cycles    result    In    less    delay.         This    is    justified   by    observing 
that    as    the    cycle    length    increases    the    number    of    cycles 
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during    the    peak    period    decreases    and   the    total    lost    time 
de  ere  ases  . 

In    fact,    if  p    is    the    percentage    of' green   time    G,     given 
to   the    first    approach,    then   the    effective    green   time   is 


a    -    pc 


(4,6.1) 


where  &,  is  the  lost  time  spent  for  acceleration  and  clearance 
The  output  rate  per  unit  of  time  Is  given  by 


Y 


S   O" 
1°1 

c 


c 


(4.6.2) 


The  above  equation  verifies  that  as  the  cycle  length  Increases , 
the  output  rate  (slope  of  the  cumulative  output  curve)  in- 
creases since  the  ratio  Z,/c   decreases.   Similarly,  for  the 
second  approach  the  effective  green  time  g?  is 


g? 


=  (l-p)c 


(4.6.3) 


tli us    the   output    rate 

[(I"      ! 


S         <T 
?  °? 


?    can   be    expressed    as 
%. 


2 


^2 


(4.6.4) 


hence   y9    also    increases   with   Increasing   c.      Therefore,    the 
total    output    rate    (Yi+Y?)    ior    the    intersection   increases   when 
c    increases.       The    final    time,    however,    decreases    as    the    total 
output    rate    increases    and   the    area  between   the    total    input- 
output    curv"es_    (i.e.,    the    total    delay)    decreases.      Thus,    it 

v;d    that    for   single    settings    of   the    signal, 
umizes    tin*    total    delay    i.s    the    maximum 


has    been   ostao.1 
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allowable  cycle  length.   The  interesting  question  is  whether 
or  not  the  same  principle  holds  true  when  the  optimal  control 
strategy  is  to  be  considered.   This  question  can  be  answered 
by  using  the  results  of  the  previously  developed  theory.   In 
sections  4.1  and  4.2  it  has  been  shown  that  the  optimal  con- 
trol strategy  results  in  less  total  delay  than  the  single 
setting  strategy.   Consequently,  the  aggregate  delay  must 
also  decrease  with  increasing  cycle  length.   The  only  compli- 
cation may  arise  when  the  cumulative  output  curves  happen  to 
intersect  the  demand  curves  before  the  end  of  the  peak  period. 
In  this  case,  it  was  shown  that  the  optimal  control  is  to 
switch  at  the  point  of  intersection  so  that  no  negative  queues 
(therefore,  slack  time)  are  allowed.   The  resulting  delay  is 
again  lower  than  that  of  the  single  setting  strategy,  demon- 
strating that  the  maximum  cycle  length  minimizes  the  total 
delay,.   The  above  results  are  illustrated  by  an  example  in 
Appendix  1. 


CHAPTER  5 
OPTIMAL  CONTROL  WITH  BUS  PRIORITIES 


5.1.   Statement  of  the  Problem 

Reduction  of  bus  delays  at  signalized  intersections  is 
one  of  the  major  problems  associated  with  bus  transportation 


-\ 


22-25  • r • 

today.      Previous    studies         •      have    shown   that   significant 

delay   savings    can   be    obtained  by   introducing   exclusive   bus 
lanes    and/or  by    granting  priorities    to   the  buses    at    signals. 
The    bus    priority    objective    Is    of   major   importance    since    the 
bus    service    cannot    fulfill    Its    function   unless    bus    delays    are 
kept    to    a   minimum   level.       Furthermore,    reduction    of  bus    delays 
increases    the    reliability    and  the    level    of   service    of   this 
mass    transportation    mode,    making  buses   more    attractive    to  new 
riders.       It    is    evident    that   bus   priorities    at    oversaturated 
intersections    are    even   more    essential    for    a   successful   bus 
service    since    the    delays    at    such    intersections    are    substan- 
tially  higher. 

Clearly,    if   public    transport    vehicles    are    to   be    given 
priority    at    intersections,    it   must  be    accepted    that    this   will 
be    accomplished   at    the    expense    of   the    other   users    of  the    ■ 
intersection.       That    Is,    the    delays    to    the    private    vehicles 
will       in    genera].,    increase    when   bus    priorities    are    introduced. 
In    recent   rears,    however,    the    Dhilosoohy    in    traffic   managenienc 
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has    changed   and   the    flow    of  people    is    considered   to  be   more 
important    than    the    flow    of   vehicles.       Thus,    when   bus    priori- 
ties   are    to  be    considered,    minimization -of  the    total   passenger 
delays    rather   than    the    total   vehicle    delays    is    the    objective 
of  the    control. 

Due    to    the    fact    that  bus    volumes    are   normally    fairly    low, 
it    is    generally    true    that   most    acceptable  bus   priority   strate- 
gies   must   provide   bus    priorities    on    a   real-time   basis;    that 
is,    the    expected   time    of   the   bus    arrivals    at    the    intersection 
cannot  be    assumed   to  be   known    a  priori ,    and  priorities    should 
be    given    only    upon  bus    detection.       In    addition,    since    the 
intersection   is    over saturated   and   long   queues    are   building 
up    during    the    control    period,    an    exclusive   bus    lane   will   be 
assumed   at   the  bus    approach.      The   bus    lane   -will   not    only   sub- 
stantially   reduce    the   bus    delays    by    allowing    the   bus    to   bypass 
the    queues,    but    it  will    also   help    to   predict    the    expected 
time    of   arrival    of   a  bus    at    the    intersection   with    reasonable 
accuracy.       In   the    analysis    it  will   be    assumed   that   the  bus 
demand   during   the   peak   period   is    known    and   that    the   buses 
arrive    from  the    approach    associated  with    the   highest   satura- 
tion   flow    (if   the  buses    arrive    from   the    other    approach, 
similar    analysis    applies) . 

With    this    preliminary    Information    a    control    strategy    to 
enhance    the   bus    priority    objective    will    be    developed. 
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5.2.   Development  of  the  Control  Strategy 

According  to  the  optimal  control  policy,  during  the 
first  interval  of  the  control  period  [0,  x]  the  green  phase 
is  maximum  on  the  bus  approach;  hence,  further  extension  of 
the  green  interval  to  provide  bus  priorities  will  simply 
violate  the  minimum  green  phase  constraint  on  the  cross  street 
Therefore,  extensions  of  the  main  street  green  phase  during 
this  interval  are  precluded.   It  is  possible,  however,  to 
shift  the  main  street  red  phase  to  the  right  or  to  the  left 
so  that  upon  bus  arrival  the  signal  indication  is  green.   This 
can  be  accomplished  without  violating  .the  minimum  green   con- 
straints,.  The  situation  is  illustrated  in  Figure  5.1,  in 
which  an"""  indicates  a  bus  arrival.   When  the  bus  arrives 
on  green  no  action  will  be  taken  by  the  controller.   The  new 
policy  provides  the  same  amount  oE  green  time  within  two 
cycles  on  both  the  main  and  cross  streets  and  thus  the  slopes 
of  the  cumulative  output  curves  are  not  affected. 

During  the  second  interval  [x,  t, ]  the  red  phase  is 
maximum  on  the  main  street;  however,  it  is  not  possible  to 
shift  this  phase  either  to  the  right  or  to  the  left  because 
such  control  action  will  violate  the  minimum  green  time  con- 
straint placed  on.  the  first  approach.   Figure  5.2  may  be  used 
to  clarify  this  point.   An  alternative  would  be  to  shift  the 
main  street  green  phase  to  the  right  or  to  the  left  upon  bus 
arrival,  as  is  done  with  the  red  phase  in  the  first  interval. 
This  control  policy,  however,  '.-.'ill  increase  the  red  phase  on 
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the  first  approach  (i.e.,  the  approach  which  is  supposed  to 
receive  priority)  beyond  the  maximum  limit  and  such  a  policy 
is  not  acceptable  since  high  red  phases  will  disrupt  the 
main  street  traffic.   Another  possibility  of  providing  bus 
priorities  during  this  interval  is  to  extend  the  green  phase 
(which  is  minimum)  when  a  bus  happens  to  arrive  within  a 
specified  maximum  range  Z  after  the  end  of  the  green  period. 
Since  this  policy  does  not  violate  any  phase  length  constraint 
it  will  be  adopted  here.   The  policy  is  illustrated,  in  Figure 
5.2  where  an  "::-"  Indicates  a  bus  arrival. 
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In    summary,    during    the    interval    [0,    t]    the   new    control 
strategy  will   provide   maximum   green   time    on   the   bus    approach 
and,    if   a  bus    arrives    on    red,    the    red  phase   will   be    shifted 
to    the    right    or   to    the    left.       During    the    interval    [t,    t, ] 
minimum  green   time   will   be    given   on   the   bus    approach    and 
extensions   will   be    granted   to   the   buses    that    arrive   within   Z 
seconds    after   the    end   of    the    green   phase. 

In    the    analysis    it   will   be    assumed   that    the    switchover 
time    and   the    final    time    remain    unchanged.       In    order    for   this 
assumption   to   hold   true    it  will    further  be    assumed   that   the 
bus    volumes    are    low    so    that    the    number   of    cycles    disrupted 
by   the   buses    is    relatively   small.      The    objective    is    to   select 
the    optimum  value    of   the   maximum  extension    interval    Z    that 
maximizes    the    total    passenger   savings    resulting   from  the 
new   policy. 

The    analysis    proceeds    as    follows.       Let   y   represent    the 
number   of    cycles    during   the    time    Interval    [x,    t-,  ]    and   x   the 
number   of  buses;    the    assumption   of   low  bus    volumes   was    meant  ■ 
to    imply    that   x   is    much    smaller    than   y,    i.e.,    x    <<   y.       Thus, 
the   probability   of   a  bus    arrival    at    any    cycle    is 

■•        Pa  -   f  <    1  _  ■  ■  ■  (5.2.1) 

where 

.     t      -    x 
y    =    ~~ (5.2.2) 

Assuming  that  a  bus  can  arrive  with  equal  probability 
anywhere  within  the  cycle  (i.e..  the  bus  arrivals  within  the 
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d  =    sin   D 


s  in  A 


A  -    90    +    8?    ■+   sin  A   =    cos    02 


tan  9, 


Si g  - j  +  s0g^  : 

l°i!iin  2&max 


D  -   o1  -   e? 


tan  6 


S       Cr  '       +      S       cr  I 

1^1  2^2 


1 


(5.2.9) 
(5.2.10) 

(5.2.11) 
(5.2.12) 

(5.2.13) 


where    gl  ,    g\    are    given  by   Eqs .    5.2.6    and   5.2.7,    respectively 
From   Figure    5.3   it    is    also   seen   that 


a   =    (t-,  -t)  /cos6. 


(5.2.14) 


Substituting  Eqs.  5.2.14,  5.2.10  and  5.2.12  into  Eq.  5.2.9 
the  following  is  obtained: 


VQ2 


d  =   sinCe, -8,3 


37 

i  -i<  cSie-.  oose.  =   Ctr-T)(tane1-tane2) 

^  [  5  .  Z .  1 5  J 


and    from   Eqs.    5.2.8    and   5.2.15    it    follows    that 


AD 


j  t ,  ( t ,  -  t  )  ( t  an  0 .  - 1  an  8  -  ) 


(5.2.16) 


Equation    5.2.16    is    further   simplified  by    using   Eqs.    5.2.11 
and    5.2.13    to    obtain 


AD 


c    =    JT  t1(t1-T)Cs1-s2)    p.  z2    =    az2 


(5.2.17) 


where 


a 


4c" 


9       1  ^    i    "^JL^-j-s-j    — 


1^1    VJ  K"l    J2-'    v 


(5.2.18) 


The    maximum   delay    saved   to    a  bus    by   extending    the    green 
phase    in    the    interval    [t,    t. ]    is    equal    to    the    maximum   red 


(1) 


phase  r":  *        Similarly,  the  minimum  delay  saving  is  r' 


CD 


.00 


max 


therefore,    the    average    delay   saving   is    r^i    -    Z/2 ,    and  the 

ill  cl-A. 

delay    saved   to    all   buses    is    given  by 


AD 


B 


ECrCl)4) 

1   max   2J 


Zrr(l)    Z      _        rmax     ' 


c  ■   max   2 


c 


x_   72 
2c 


(5.2.19) 

If  E1  and  E?  represent  the  average  automobile  and  bus 
occupancies  respectively,  then  the  total  passenger  savings 
are 

) 

E  9    -     (  a  Z    )  E  - 


S    =    AD,,    -    AD 
B  c 


fxZ    r(1) 
max 


X      72 

2  c    -J 


1 


(E 


X 


2c 


i', ,  a 


E,x    r^' 

2         max 


(5.2.20) 


Th  a 


ie   optimum  extension   is    obtained  whe 


n 


8  8 


dS  : 

d^Z 

solving    for    Z 


rE0x 


+   E,  a 


n  a.  a    i 

z  +  .J HL^A  =  o 

c 


(5,2.21) 


(1) 
E„x   r 

2        max 


=    Z 


E?x   +    2E- ca  opt 

From   Eq.     5.2.21    the    following    is    obtained 


(5.2.22) 


d__y3 
dZ2 


=    S" 


E?x 
j2c-+    V 


(5.2.2  3) 


However,    a   is    always    positive   because   x,    E,  ,    E„    are   positive, 

S,    is    greater   than   s~    and   t-,    is    greater    than   x.       Therefore,    S" 
Is  2  1° 

is    always   negative,    indicating   that    Z  (Eq .    5.2.22)    maxi- 

'  &  '  °  opt 

mizes    the    total   passenger   savings    S    (Eq.    5.2.20). 

A  few    important:    remarks    about    the   bus    priority  policy 
are   necessary    at    this   point. 

1.  The    red  phase    during    the    first    interval    [0  ,    t]    can 

be    shifted  to    the    right    or   to    the    left   by    at   most    gJr;.    -    gT -i 

niaA  mm 

seconds    so   that   the   minimum   green   time    constraint    on   the   bus 
approach   is   never  violated. 

2.  The   bus    priority   policy  will    increase    the    total 
green   time    of  the    first    approach  by   T    (Eq^    5.2.26)    in   the 
interval    [t.    t J ,    and  because    the    final    time    and    the    switch- 
over   point    are    assumed    constant    the    maximum   green    time    in    the 
interval    [0,T    ]    will   be    slightly    decreased  by    the    amount 


5g 


TfE 


Tc 


(5.2 . 24) 


Thus  the  new  value  of  the  maximum  green  time  will  be 
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a  '-     J     -     n  L     '      -     6  a  f"  C     9     ?  C  "i 

tomax        °max  &  ^'A'    •'J 

This    decrease,    however,    will    be    very    small    because    of   the 

low  b us    volumes . 

3.      The    value    of  the   maximum  extension   cannot   exceed   an 

upper   limit;    this    upper    limit'  fZ        )    is    equal    to    e  -    cAf-'  • 

.  .  •   aax;  L  cmax        °min' 

extensions   beyond   this    limit  will   violate    the   minimum   green 
time    constraint   placed   on   the    second   approach.      Thus,    if   the 
value    of   the   maximum  extension   obtained   from  Eq.    5.2,22    is 
higher   than    Z         ,    the    value    of   Z  should  be    used   for   the 

Hi  3.X  U13.X 

optimum  extension. 


CHAPTER   6 
SYSTEMS    OF    OVERSATURATED    INTERSECTIONS 

6,1.      Formulation    of   the  -Unconstrained  Problem 

The    problem   of   optimizing    the    operation    of   more    than    one 
overs  at urate d  intersection    in   succession    is    studied  in   this 
chapter.      To    simplify    the    analysis    initially   two    overs aturated 
intersections,    such    as    the    ones    in    Figure    2.2,    are    considered. 
Extension    of   the    theory    for  more    than    two    intersections    is 
straightforward   and   is   presented  in   Chapter   7. 

Consider    a   system   of   two    intersections    serving    the    traf- 
fic  streams    1,    2,    3,    and   4    as    shown    in    Figure    2.2.       If   it    is 
assumed  that    (1)    the    tra\rel    time   between   the    two   intersections 
is    zero,     (2)    no   turning   movements    are    involved,    and    (3)    the 
queue ing    storage   between    the    two    intersections    is    zero,    the 
analysis    is    greatly    simplified.      However,    since    the    two    inter- 
sections   are    treated   as    one,    this    formulation    does   not    reflect 
real-world   conditions.      To  place    the   problem   on    a   more    real- 
istic basis,    these    assumptions   must  be    removed.      The    general 
minimization   problem   can    be    formulated   in    a  manner   similar    to 
the   previous   problems, 

P  r  o  b  1  e  m :     '  M  i  n  i  m  i  z  e    t  h  e    del  ay    f  u  n  c  t  i  o  n 

D   =    /      Cx1+x.+x3+x4)dt  (6.1.1) 

o  * 

9  0 
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subject    to 


£ 


dx 
1   =    dt 

dx 


1 


q1-u1 


2 


Ll,     .     S2 


2         at  l2      2-      c ,  s  -,       1 


f, 


dx3 

dt 

dx. 


q3-u2 


x 


dt 


q, 


4    "4 


(1-^-3 


—  u0 

S3      2 


with    the   boundary    conditions 


x1(0) 


x2(0) 

x3(0) 
x,(0) 


0 
'1 


x. 


0 


x 


w 


x2ct1) 


x3Ct1) 


x4(tx) 


0 
0 
0 
0 


arid   the    admissible    control    domain 


f  1 1 
s.,  e    ■    /c 


S„g     - ' /c 
2°min 


mm   -     1    -     l6max/ 


u„    <   s,gj;3i/c 

—       7  &tt1  "  "- 


mm  —     2 


'max 


-    u 


=    u, 


(1) 
max 

(2) 
"max 


(6.1.2) 
(6.1.3) 
(6.1.4) 
(6.1.5) 


(6.1.6) 
(6.1.7) 
(6.1.8) 
(6.1.9) 


(6. 1.10) 
(6.1.11) 


In   the    ab  o ve    f  o rraul  at  i  on  , 

t.,    is    the   end   of   the    overs  at  ur  at  ion   period 
x.  (t)     =   x-     is    the    queue    length    on    approach    i,    1=1,2,3,4 
q.j  (t)     =   q.     is    the    input    flow    rate    on    approach    i,    1  =  1,2,: 
s^    is    the    saturation    flow    on    approach    i,    1=1,2,3,4 


u ,  ( t ) 


u. 


[  S  .,  g,  ( t)  j  /c  .    Is    a    control    variable    associ 


lsl 


ated  with   the    first   intersectio 


n 


u  2  ( t )    =   u  „    =    [s,g3(t3]/c2    i  s    a   c  on  t  r  o  I    v  a  r  i  ab  1  e    as  s  o  c  I  a  t  e  d 

w 1 1 h    t h e    s e  c o n d   intersec t i on 
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g.  (t)  =  g.  is  the  effective  green  time  on  approach  i', 
1       x  i  =  1 , 2  ,  3  ,  4 

fil 

g„    -     is    the   maximum   green   time    on    approach   i,    1=1*2 ,3.4 
"max  rt  '  '    '    ' 

gj" .  "l    is    the    minimum   green   time    on    approach    i,    1=1,2,3,4 

c.    is    the    cycle    length    of   intersection    j,    j  =  l,2 

L.    is    the    total    lost    time    of   intersection    j,    j=l,2     . 

x.    is    the    queue    length    at    time    zero    on    approach    i,    1=1,2,5,4 

f 
x;,    is    the    queue    length   on   the    third   approach    at    the    final 

time. 
The    implicit    assumption    is    made   here    that   the    cycles    c, 
and   c2    are    constant  while    the    green   times    can   take    on    any 
value   between    a  maximum   and   a  minimum.      At    the   beginning   of 
the    control   period    the    queues    may   have    values    other   than    zero, 
whereas    at    the    end   all   queues    have   been    dissolved.      The    demand 
on   each    approach    is    time    varying;   however,    the    demand   on    the 
third   approach    is    a   function    of   the    output    of   the    first    inter- 
section.     This    function    can  be    determined  by    taking   into 
account    the    left    turns,  on    the    first    approach,    the    right   turns 
on    the    second   approach,    and  the"  travel    time   between   the    two 
intersections.      Alternately   stated,    the    input    to   the   third 
approach   is    equal   to    a  portion    of   the    output    of   the    first 
intersection    after   some    time    delay    d-,  .       If   a   represents    the 
percentage    of    through    vehicles    of   the    first    approach    and  b 
the    percentage    of   vehicles    turning    right    on    the    second 
approach,    then    the    demand    on    the    third    approach    is    given   by 
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q3(t) 


=    a 


1"  " 


fs2[c1-g1Ct-d1)-L1]] 


I 


'1 


a   u1(t-d1)    +    b 


L 


S9(l-—-j     - 

cl  1 


r 


=   a  u,  (t-  d, )    +  b 


I 


Ll 
1 


'1 


u1(t1-d1) 


a   -    b    J]u.  (t-d   )    +   bjs2Cl~)| 

S^J       X  J.  ^      i,  1      -1 


(6.1.12) 


Let 


and 


S2  S4 

s ,  1    '         s  -  2 

1  3 


L  L? 


(6.1.13) 


(6.1.14) 


then   6.1.12    can  be    rewritten    as 


q3(t)    =    (a-b£1)u1(t-d1) 


bm.n 


(6.1.15) 


The    time    delay    d,    can  be    assumed   to  be    equal    to   the    travel 
time    corresponding   to   the    average    speed  between   the    two 
intersections.      The    average    speed  is    either  estimated   from 
knowledge    of   local    conditions    or,    preferably,   measured   using 
floating    car  techniques    as    suggested   in   References    26    and   2  7 
As    in    the    previous    problems,    the    artificial    state    vari- 
able   x„    is    introduced   such    that 
U 


ax, 


3t 


-    VWX4 


(6.1.16) 


with    initial    and    final    conditions 


Xq(0)    =    0       and      xn(ti) 


ree    to   vary 


(6.1.17) 
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Considering   Eqs .    6.1.13   through   6.1.17,    the   problem  takes 
the    following   equivalent    form. 

Problem:      Minimize    the    delay    function 


t 


1 


Mm   D  -   f      (x,  +x0  +  x,+x,)dt   =   xn(t,)    -   Ma; 

v    1      2       3      AJ  0  ^    1J 

o 


-  -^0(t13 


(6.1.18) 


s  ub  j  e c t    to 


dx 


f 


0 


0         dt 
dx 


1 


f. 


1         dt 
dx? 


dt 
dx, 


1      2       o      4 


^rui 


<VV  £iui 


3  dt 


^ 


dx 
:4   =    dtT 


(a-b&, )  U-,  (t-d, )  +bm,  -u?  (t) 


q , -m9+£7u 


4      2      2    2 


with    the   boundary    conditions 


x.  (0)    =    xV      and     x-  ft,) 
i v    -  i  l  ^    1 


and  the  admissible  control  domain 


(j) 


<   '         <    u  .    <    u  ^  -1  •* 
mm  —     j    —     max 


j    =    1,2 


(6.1.19) 
(6.1.20) 
(6.1.21) 
(6.1.22) 
(6.1.2  3) 


i    =    1,2,3,4       (6.1.24) 


(6.1.2S) 


The    implicit    assumption    is    made   here    that   the    parameters    a, 
b  ,    an  d   d  1    are    c  o  n  s  t  a  n  t . 

The   Hamilton!  an    function    for   the    above   problem  is 
de  Fined   as 


9  5 


H   =      I      A.f.    =    A0(x1  +  x2  +  x3+x4j    +    A^q^u^ 

1  —  u 

+    \    (o^-m  +1   u   )    +    ^[(a-bLju-  (t-d1)+bm1  -u9] 


■2^t7    •"!    -i"! 


+    A4[q4-m2+^2u2] 


r  lv   1" 


1   2 


(6.1.26) 


The  adjoint  variables  An  ,  A-,,  A?  ,  A~,  and  A,  are  given  by 


dA, 


3H 


dt 

3xQ 

dX, 

3H 

dt. 

3x1 

dA2 

3H 

dt 

3x2 

dA_ 
3 

3H 

dt 

3x, 

dA4  _ 

3H 

=  0 


"  "xo 


dt 


3x 


(6,1.27) 
(6.1.28) 
(6.1,29) 
(6.1.30) 
(6.1. 31) 


The    solutions    to   the    above    equations    are 


kn    =    const 

-V+ki 

~V+k2 
"k0t+k3 
-k0t+k4 


(6.1.32) 
(6.1.33) 
(6.1.34) 
(6.1.35) 
(6.1.36) 


where 


.,.,  ,  k-,  ,  k0  ,  k^,  and  k,  are  the  integration  constants 

U  1  L  O  4 


Since    xn ft 


0'-    1 


t-.  )    is    free    to    vary,    it    to  Hows    that 


dV 


\     ft     ')     ^ l± _  =    V 

ol'iJ       8xortiJ         ° 


(6.1. 37) 


Hen  a 
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A:[(t)    = 

■    t    +   kl 

x2(t)  - 

-    t    -:-    k2 

A3(t)    = 

-    t    +    k3 

A„(t)  =  t  +  k 


Sub  sti  tut.Ing  the  A  '  s  Into  6.1.26, 


(6.1.38) 

(6.1.39) 
(6.1.40) 
(6.1.41) 


H-  -l(x1+x2+x3+x4)    +    (t+k1)Cq1-u1)    +    (t+k2)Cq2-m1+Jl1u1) 

+  Ct+k3)[Ca-bA1)u1Ct-d1)+bm1-u2]    +    (t+kj  [q4-m2  +  £2u2  ] 

-  [-t-k1+£](t+k2)]u1   +    [(t+k3)(a-b£1)]u1(t-d1) 

+  [-t-k3+£2(t+k4)]u2    -    (x1+x2+x3+x4)    +    (t+k1)q1 


(t+k2)  (q2-k]_)    +    (t+k3)bm1   +    (t+k4)  (q^n^) 


=    z 


Lll   +    C^+k3)  (a-bi1)u1(t-d1) 


Z-U-    +    w 


where 


*1 

7 

^2 
w   = 


-t-Wt+k2) 

-t-k3+£2(t+k4) 

-(x1+x2+x3+x4)    +    Ct+1 
(t+k4) (q4-m2) 


lJql 


(6.1.42) 

(6.1.4  3) 
(6.1.44) 

(6.1.45) 


This    is    not    a   trivial    control   problem   since    the  control    vari- 
able   u,    appears    in    the    equations    of   the    process  both   without 
delay    and  with    delay    d, ,       The    solution   proceeds  by    introducing 
the    shifted  Hamiltonian    function   H,  ,    defined   as 
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H-l    -  I-I(t)    +    H.Ct+d,) 

=  z1(t)u1(t)    +    Ct+k3)Ca-bA1)u1(t-d1)    +    z2(t)u?(t) 

+  w(t)    +    z1(t+d1)u1(t+d1)    +    (t+d1+k3)Ca-bi1)u1Ct) 

+  z2(t  +  d1)u2(t+d1)    +  w<t+d1)  (6.1.46) 

The   maximum  principle  with   nontrivial    time    delays    of   the    con- 
trol  is    discussed   in   Reference    28,   where    the   necessary    con- 
ditions   tor   optimality    are    also    derived.      Application   of   the 
maximum   principle    to    the    previous    time-delayed   system  yields 
the    following  necessary    conditions. 

Theorem:       For   the   optimality   of  the    controls    u,    and   u 
and   their   trajectories,    it    is    necessary    that    there   exists    a 

T 

nonzero  vector  function  A  (t)  =  U0(t),  X,(t),  \~  (t)  ,  A,.(t)  , 
A^Ct)],  satisfying  Eqs .  6.1,2  7  through  6.1.31.  Furthermore, 
X    (t)  is  such  that 

dx0         3H  .    .  , 

(6.1.47) 

(6,1.48) 

(6.1.49) 

ar1  =  9x7  •  (6-1.50) 

dx 

W   =  3AJ  .  (6.1.51) 

In  addition,  the  following  conditions  must  be  satisfied: 


dt 

3AQ 

dx2 

3H 

dt 

3  X 

dx2 

3H 

dt 

3X2 

dx, 

3U 

on 
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1.  H(t,u*  u|)  =  Max  H(t,u,,u2)     0 ,1*1*1 

ff1Ct,u|,u*)  =  Max  ^(t.LUj  ,u2)    t-d1<t<_t1-d1    (t>d1) 
i.e.,  the  optimal  control  must  maximize  the  Hamiltonian  and 
the  shifted  Hamiltonian  at  each  time  point  in  the  above 
intervals . 

2.  H(t1?uJ,u*)    =    0 

Condition    2    states    that    the   Hamiltonian    function    at    the    final 
time   must  be    zero.      To   satisfy    the    first    condition    as    stated 
above,    it    Is   necessary   to   examine    the    signs    of   3H/3u   and 
3FL/3U   as    In   section    4.1.      Thus,    differentiating   6.1.42   with 
respect    to   U-,  ,    the    following    is    obtained: 


3TT7  =    zl  (6.1.52) 

and  since    z,    is    a   linear   function   of   time,    there    is    at   most 
one    time   point    at  which    9H/3u,    becomes    zero.      Plotting   the 
function   H   versus    u,  ,    the    following    results    are    obtained    (see 
Figures    4.2,    4.3,    and   4.4): 

1.  If     |IL  -    2      >    o   *   u*   -    u(1) 

3u,  1  1  max 

2.  If     ~-  =    z.    <   0    ->  u*   =    u^      and 

3u,  1    -  1  mm 

l 

3.  at      •*— -  =    0      switch    from   u^    '    to    u^.r     . 

3^2  max  mm 

Similarly,    differentiating    6.1.42    with    respect    to    u?  ,    it    can 
be    easily    verified   that 

3  H  f?"\ 

3u0  2  2  max 
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2.  ir      ?r — ■  =    zn    <    0  ■*  uS    =    u    -         and 

3u?  2  2  mm 

-       3H  n       e  ,4*    t,     r  (2)     +  (2) 

3.  at      ~ =    u      switch    from   u^    J    to   uv.       . 

3u9  max  mm 

Likewise,    in   order  to   maximize   H,    the    following    control   must 
be    applied: 

1.      If     *—  =    z1    +    (t+d  +  k„)  (a-b£j    =    z^    >    0 

a  U-|  1  _L        o  1 

1  max 

if    v-^  -  zo  >  o  ■+  u*  =  uUJ. 

3u?  2  2  max 

3u,  —  1  mm 

3R1  m 

If      «-=-  =  .z,    <    0    -»-  u*    =    ulzJ. 
du„  2    —  2  mm 

3H1  fV]  n  1  fil 

.5.      At      — -  =    z(-±J    =   0      switch    from  uUJ    to   uL1-\ 
3u,  max  mm 

3H 

i  c?i  r?Ni 

At   ^ =  z      -    0   switch  from  uv"J  to  uv"J. 

3u-     2  max     mm 

It  should  be  noticed  that  in  the  common  interval  [d,  ,  t-,-d,  ] 
both  H  and  H,  must  be  maximized  with  respect  to  u,  and  u? . 
Also,  since  z?  is  a  linear  function  of  time,  there  will  be  at 
most  one  time  point  at  which  u„  is  switched.   It  is  therefore 
concluded  that  when  no  constraints  are  imposed,  the  optimal 
control  policies  of  u,  and  u?  exhibit  at  most  one  switch  each 
n  o  t  n  e  c  e  s s  a r i 1 y  a  t  the  s  a  me  t  i me  point, 

In  the  previous  analysis,  no  specific  assumptions  have 
been  made  concerning  the  demand  curves  Q_  ,  Q?  ,    Q_,  and  Q,  . 
Assuming  linear  demand  curves,  a  closed  form  solution  can  be 
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found  for  the  switchover  times  and  the  final  time  t,-.   This 
solution,  however,  is  of  little  value  since  linear  demand 
curves  are  unrealistic.   Furthermore,  the  control  policy 
allows  negative  queues  and  it  is  necessary  to  develop  the 
theory  to  remove  this  defect. 

6.2.   Optimal  Control  with  State  Variable  Constraints 

The  problem  of  constraining  the  queues  is  discussed  in 
this  section.   Clearly,  the  theory  developed  in  section  4.2 
is  applicable  to  the  queues  x-,  ,  x« ,  and  x.    since  the  state 
equations  for  these  queues  are  not  affected  by  the  time  delay 
d, .   However,  x7  is  affected  by  the  time  delay  and  it  is  of 
interest  to  examine  the  case  where  upper  and  lower  bounds  are 
placed  on  this  queue.   If  cu  and  zero  are  the  upper  and  lower 
bounds,  respectively,  it  is  required  that 


a. 


(6.2.1) 


and 


x,  > 


(6.2.2) 


When  the  above  constraints  are  strict  inequalities  (i.e.  ,  if 

x^  <  a„  or  X,  >  0)  for  the  entire  control  interval  [0,  t, 1  , 
3     3'      3  1 

the  control  variables  u,  and  vu  are  not  affected.   One  only 

needs  to  ask  how  the  control  is  affected  when  the  constraints 

( 1 )    f  2  ) 
are  at  equality  for  a  finite  time  interval  [t,  '  ,  ti  J"\  , 
1  3   '   3  ■    ' 

i.e.,  what  happens  when 


(6.2.3" 
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or 


Let 


and 


x. 


=  X. 


a.  =  0 


0 


(6.2.4) 


(6.2.5) 


(6.2.6) 


Without  loss  of  generality,  consider  the  constraint  6.2.1, 
Since  Eq.  6.2.5  holds  as  an  identity  for  a  finite  period  of 
time,  i.e.,  it  is  true  independently  of  the  value  of  t  in 


the  interval  [t 


(1)  A2) 


} ,  it  can  be  differentiated  with 


respect  to  time  to  obtain 


dx. 


di 


dt 


I  .  o 


(6.2.7) 


or,  using  Eq.  6.1.22, 


(a-b&i  )u,  (t-d, )  +  bm. 


u9(t)  =  0 


hence , 

u,(t) 


(a-b^1)u1  (t-d,)  +  bm1 


(6.2.  8) 


(6.2.9) 


Therefore,  when  x,  is  at  the  upper  bound  for  a  finite  period 
of  time,  the  control  action  at  the  second  intersection  at 
time  t  is  a  function  of  the  control  action  taken  at  the  first 
intersection  at  time  t-d,.   In  the  special  case  where  a  =  1 


and 


1 


0  ,   Eq.    6.2,9   yields 


u2  (t)    =    u1(t-d1) 


(6.2.10) 


Equation    6.2.10    indicates    that   when   no    turning   movements    ar< 


io; 


involved,  the  control  action  at  intersection  2  is  the  same 
as  the  control  action  taken  at  intersection  1,  d,  time  units 
earlier. 

The  adjoint  variable  X,(t)  in  the  interval  [ti   ,  ti    '  ] 
is  derived  from  Eqs.  6.2.9  and  6.2.5.   Let 


R. 


(a-b£]  )u,  (t-d, )  +  bm,  =  iu  (t)  =  0 


t^<t<t!;2j       (6.2.11) 


at    time    wJ    it    is    required   that 


V',15>  -  «3Ct(«) 


(6.2.12) 


:hus  .    X_    is    given   by 


dA 
dt" 


-    f!£s 

J-0     1^5 


3  u. 


i  3u„  ' 


3R   1 


dX. 


(6.2.15) 


Substituting  R,  from  Eq.  6.2.11  and  the  f.'s  from  the  state 
equations  6.1.19  through  6.1.25  into  Eq.  6.2,15,  one  finally 
obtains 


dA 


dt 


-  0 


t<»<t<t«) 


(6.2.14) 


Equation  6.2.14  shows  that  A~  is  constant  in  the  time  inter- 


„  i  r*.Cl)   ,.(2)1    c   „, 

val  [ti   ,  ti  -i,   Furthermon 

0         0 

the  following  condition 


(1) 

,    at   time    tr  -'  ,    X,   must   satisfy 

JO 


3S. 


-  Tj-i  -  x-(t£ 

3    3x,  3      3 


(1) 


p  ,    (6.2.15) 


Therefore,    the    constant    value    of    X-    during    the    interval 
r,(l)       ,(2) 


J    is    obtained    from   Eq.    6.2.15.       Proceeding    as    in 
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section    -1.5,    it    can  be  .easily   seen   that 


,-(D    .    t(2) 


<    0 


(6.2.16) 


Since  R~  must  be  zero  in  the  interval  [t^ 


(1)       .(2) 


ti    J]  ,    Eq.     6.2.9 


should  be    used   to    compute    u? ,   whereas    u,    is    computed   from   the 
signs    of    3H, /9U-,     and    3H/3u,  .       From  Eq.    6.2.9    it    is    also    seen 
that 


s,gt(t)                    s?      s    g ,  (t-d-,)  L 

___£_; =    (a-b    ~j    -i-i i-  +   bs?(l---) 


(6.2.17) 


Thus,  g-(t)  is  computed  from  the  above  relationship.   If  the 
cycles  c,  ,  c0  and  the  saturation  flows    s1?  s ,  are  equal,  it 

follows  that 


(t)  =  (a-b  il)g1(t-d1)  +  b  ^   (c1-L1) 


(6.2.18) 


and  in  the  special  case  where  turning  movements  are  pro- 
hibited , 


3(t)  -  gl(t-dl) 


(6.2.19) 


i.e.,  the  green  time  at  the  third  approach  is  equal  to  the 
green  time  at  the  first  approach  d1  units  of  time  earlier. 
When  constraint  6.2.2  is  imposed,  Eqs .  6.2.6  and  6.2.7  yield 


dSL    dS. 


dt 


dx  , 

dt 


(6.2.20) 


Therefore,  the  same  equations  apply  for  the  computation  of 
the  control  variables  u  and  the  adjoint  variable  \~. 
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The  problem  becomes  more  complex  when  two  or  more  con- 
straints are  imposed.   For  example,  suppose  that  constraints 
are  placed  on  the  queues  x?  and  x*  such  that 

x?  <  a?  (6.2.21) 

and 

X-  <  <*-  (6.2.22) 

When    constraint    6.2.21    is    at    equality,    u,    must   satisfy   Eq. 

4.2.33,    i.e., 

L  s 

Ul    =     [s2tl"'c^:)"q2]    s~  (m1-q2)£1  (6.2.23) 

Similarly,  when  constraint  6,2.22  is  at  equality,  u,.  is  com- 
puted from  Eq.  6.2.9.   Equations  6.2.2  3  and  6.2.9  form  a 
system  of  two  equations  with  two  unknowns  which  have  the 
solutions 

Ul  =  (inl"q2'£l  (6.2.24) 

u2  -  (a-b£x) [m1-q2(t-d1)3A1  +  bn^  (6.2.25) 

Therefore,  when  both  constraints  are  at  equality  simultane- 
ously, u.  and  u?  are  uniquely  determined  from  Eqs .  6.2.2  3 
and  6.2.24.   If,  however,  more  than  two  constraints  are 
imposed  and  they  are  at  equality  simultaneously,  the  problem 
is  impossible  since  it  involves  the  solution  of  a  system  of 
more  than  two  equations  with  only  two  unknowns  (the  two  con- 
trol variables).   To  circumvent  this  difficulty,  it  will  be 
necessary  to  let  the  cycles  c,  or  c,  or  both  (depending  on 
the  number  of  constraints)  free  to  vary  between  a  maximum 


10! 


and  a  minimum  value.   If  the  resulting  cycles  lie  outside 
their  specified  bounds  the  constraints  will  be  violated. 

6.3.   Solution  to  the  Unconstrained  Problem 

For  the  solution  of  the  general  minimization  uroblem 
with  time.- varying  demands,  turning  movements,  and  time  delays 
of  the  control,  it  is  necessary  to  turn  to  numerical  tech- 
niques.  If  minimization  of  the  total  system  delay  is  the 
only  objective  of  the  control,  the  following  algorithm  is 
applicab  le . 

STEP  1.    Assume  values  for  k, ,  k?  ,  k,,  and  kA. 

Since  the  integration  constants  k-,  ,  k?  ,  k-,  and  k*  (Eqs  . 
& . 1 . 32  through  6.1.36)  that  are  necessary  for  the  computation 
of  the  adjoint  variables  are  unknown,  initial  values  must  be 
assumed.   The  optimal  solution  is  found  by  iterating  on   k, , 
k .-,  ,  k,.  an d  k  , . 

STEP  2.    Set  tfl}  =  0,  x^t^)  =  0,  x^t^ )  =  x° , 

The  time  is  set  equal  to  zero  (beginning  of  the  control 
period)  and  initial  conditions  are  the  ones  prescribed  for 
t  h e  s  p  e  c  i fie  p r o fa  1 e  m . 

J.  £ 

STEP    3.         Put    i    =    i  +  1,      t^1'    =    t^+At      and 


X0 


A 


ft 


CDi    -   tCi)+lc 

J         —         X.  r  A.  ■ 
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>(i),    Ai)^ 


A  -^  (^  L  ""    J   —   X      ■  iv.-j 


4 

This  step  perforins  numerical  integration  of  the  adjoint  vari 
ab les  (Eqs .  6,1.27  through  6.1.31). 

STEP  4,    Find  the  values  of  z's  at  t*-1-',  i.e., 

z(1}  -  Z1  +  (a-bA1)  [t(l^  +  d1+k3]  -  8H1/3u1 

zx   =    -t('^    -  k2  +  ^[t^+k,]  -  3H/3u1 

z2    =    -t^     -    k3   +    £2[t^+k4]    =  3H1/3u2    =    3H/3u. 

The    values    of   z's    are    used  to    determine    the    optimal   policy. 

STEP    5,         Examine    the    signs    of    the    z's    and   determine    the 

optimal    controls    u*    and  u*. 

If   z^    >    0    and   z,    >    0   ■*   u*    =    u'll\ 

1  1  max 

If    z^    <    0    and    z,    <    0    -*   u*    =    u^  . 
—  1    —  1  mm 

If     Z^      =     z1    ■-     0    -     TX    -     t(i). 

If   z      =    >0   ■*■   uS   =*   uv   J . 

2  2  max 

If    z0    <    0    ■>   u*    -    u^  . 
2    —  2  mm 

If     Z,     =     0     +    T2     -     t(1). 

The  optimal  controls  u?  and  u£  must 'maximize  the  Hamiltonian 
and  the  shifted  Hamiltonian  at  each  time  point  in  the  common 
interval    [d,  ,    t,-d,  ].       If   m1-1     lies    outside    of   this    interval 


the    optimal    value    of   u,     is    determined    only    from   the    sign    of 


F      7 


'1 


STEP  6.    Determine  the  current  state  of  the  system. 

^it{lh   -  H{til-lh    -   [qirt^^-ulCt^b]At  i 
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x2(t(l))    =   x2Ct(i"1})    +    [q2_CtCi))-m1+£1u1(ti)]At 

>w(t(l))    =    x3(t(l-1))    +    [(a-b£1)u1Ct-d13 

+  bnu-u, C"t       ) ]At 
x4(t(i^    -   x4Ct(i-1})    +    [q4(t(i}}-Hi2+    2u2(tCi})]At 
xQ(t(l))    =   x0(t(i"1J)    +    [x1(t(i))  +  x2CtCi)) 

+x3CtCi))+x4Ct(:i))}At, 
If   xi    <    0  1=1,2,3,4  set    x.    =    0    and    follow 

Steps    2a,    3a,    5a,    and  6a  of   the    constrained 
algorithm. 

This    step   performs   numerical    integration    of   the    state    equa- 
tions   6.1.19    through    6.1.20. 

STEP    7.         Examine    the    value    of  H. 

Is    H   -    z1u1+(t(-1-)+k3)u1(t^1^-d1)  +  z2u2+w   =   0? 

If  "yes"  put  t1  =  t*-1-',  D=  xQ  and  go  to  Step  8. 
If  "no':  return  to  Step  3. 

Since  at  the  final  time  H  is  zero,  the  process  must  continue 
until  H  becomes  zero.   The  total  delay  accumulated  to  this 
time  point  and  the  final  time  are  the  optimal  if  the  remain- 
ing conditions  are  satisfied. 


Chech  the  state  of  the  system  at  t,  . 

Is  the  final  state  reached? 

If  "yes,"  i.e.,  if  x^t-,)  =  0    1=1,2,5,4  ■*   END. 

If    "no"    assume    new    values    for  x.         1=1,2,3,4 

X 


n  n.  cl   re  t  u  m    t  o   Step 
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In   this    step    the    state    of   the    system   at    the    final    time    is 
checked   to    determine   whether   or  not    the    optimal    solution   has 
been    found.       If   the    final    state    is    the    desired   one,    the 
assumed   values    for   k, ,    k~ ,    k,,    k.    are    correct    and   the    itera- 
tive  process    is    terminated.      Otherwise,   new   values   must  be 
assumed  by   using    an    optimization    routine   which  will   minimize 
the    objective    function 

I    -    x^tp2    +    x2(t1)2    +    x3(t1)2    +    x4(tl)2 

Therefore,  Step  8  Is  performed  by  the  optimization  routine. 

The  obtained  solution  is  the  optimal  because  when  the 
algorithm  terminates,  all  the  necessary  conditions  have  been 
satisfied.   Namely,  (1)  the  Hamilton! an  functions  have  been 
maximized  with  respect  to  time  at  each  time  point  (Step  5) , 
(2)  H  is  zero  at  the  final  time  (Step  7)  ,  and  (3)  the  initial 
and  final  conditions  are  the  specified  ones  (Steps  2  and  8). 

6.4.   Solution  to  the  Constrained  Problem 

If  constraints  are  imposed  on  the  queues,  the  preceding 
algorithm  applies  only  when  the  queues  remain  below  their 
specified  bounds.   When  the  bounds  are  reached,  It  is  neces- 
sary to  follow  additional  steps  that  will  be  developed  in 
this  section.   Without  loss  of  generality,  it  will  be  assumed 
that  constraints  are  placed  on  queue  x,  which  is  affected  by 
the  time  delay  d,  ,  i.e.  , 

0  I  xi  £  <**  (6.1.10 
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To    satisfy    this    constraint    the    algorithm   changes    as    follows 


STEP    1.         Assume    values    for  k ,  ,    k~ ,    k~,    and   k,. 

STEP    2.         Set    tCl}    =    0,    xQ(tCi))    =    0,    x1(t(i))    «    xj , 

x.  It        J    -   X-,,    X-^T         J    -    \_    and  x,(tv      )    =    x. 

Steps  1  and  2  are  similar  to  Steps  1  and  2  of  the  uncon- 
strained algorithm. 


STEP  2a.   Check  the  length  of  queue  x,, 


If  x3(tl"LJ)  >  a3  or  x„(tUj)  <_  0 

put  u*(t^)  -  (a-b£1)uj(t(;i^-d1)+bm1 


If,    however,    u*(t^)    <    u  ^    or   u*ft^l    >    u  ^ 
'      2  -  mm  2  "  ->  max 

the    problem   is    impossible. 

If  x3(t^)    >   a3   or   x3(t^)    <   0 

put  x ~(t^)  =  a   or  X-Ct^J  -  0  and  go  to  Step  3a. 

When  the  limits  tend  to  be  exceeded,  the  control  u$  is  com- 
pute d  from  Eq .  6.2.9. 

STEP  3.    Put  i  =  i+1,   t(i)  -  t(i)-At   and 
XQ  =  -1 

M't(i))  =  t^+kl 

x2(t(l))  =  tCi)+k2 

x,(tCi))  =  t^+k. 

A4ct       j  -    t        'k4 

Co  to  Steo  4. 


This  step  is  similar  to  Step  3  of  the  unconstrained  algorithm 
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STEP  5a „ 


Put  i  =  i+ 1 , 
A0(tCl))  -  -1 

x1(tCi:))  =  t(i)+k 


t'^  +  At   and 


-k. 


A4Ct(l))  =  t(i)+k4. 
Go  to  Step  5a. 


In  this  step  the  adjoint  variable  X,  is  kept  constant;  the 
step  is  bypassed  if  the  constraints  are  not  at  equality. 


STEP    4 


Find  the   values    of   z's    at   t 


(i) 


l .  e 


z^    =    z,    +    (a-b*,)[t^  +  d,+kT3    =    3H./3U, 

J-  1  13  11 


-t^   =  kx  +  ^  [tCl^+k9] 


Z2    =    "* 


(i.) 


-    k 


1 
£„[■ 


■2 


3K/3u1 


Ci)*v 


k4]    =    3H1/3u2    =    311/  3  u. 


STEP    5.         Examine    the   signs    of   the    z's    and   determine   the 
optimal    controls    u*    and   u* 

1  L 

If   z^    >    0    and   z1    >    0   ■*  u*   =    u^  . 

1  1  max 


If   z 


^    <    0    and   z,    <    0   -»■   u*   =   u^  . 
1   —  1  mm 


f    7  (lj     _     7        _n_>T        _     t  (lj 
I     Z  Z][  U  T1  Z 


If     Z, 


0    ->   u*    =    up\ 

2  max 


If 

Z2 

< 

0 

-> 

u2 

= 

mm 

If 

•7 

~2 

= 

0 

-> 

T2 

= 

t<« 

Go    to    Step    6. 


Steps    4    and    5    arc    the    same    as    in    the    unconstrained    algorithm. 


Ill 

STEP    5a.       If   z^    >    0    and   z,    >   0   -*  u*-  =    u^K 

1  1  max 

If    z^Vj    <    0    and    z.,     <    0    ->   u*    =    u^\ 
—  1   —  1  ram 

u*   has    been    determined   in    Step    2a. 

This    step    is   bypassed   if   the    constraints    are   not    at   equality. 
According    to    the    results    of   section   6.2,    uS    is    a    function   of 
u*    at   time    t-cL    and   is    not   determined   from  the    sign   of   z? 
but    rather   from  Eq.    6.2.9. 


STEP   6.         Determine    the    current   state    of   the    system. 

x1(t(l))    =    x1(tfl_1))    +    [q1Cttl})-u1(ttl^)3At 
x2(tCi))    =    x2CtCi~13)    +     [q2Ct(i))-m1+£1u1CtCi))]At 


X3 


(t(i))    =   x3(t(i"i:))    +    [Ca-bJl1)u1Ct-d1) 


-bm,  -v.*  C^        3  ]  At 


x4(t(i))    -    x4(t(i-1})    +     [q4(t(i))-m2+£2u2(t(i))]At 
x0(t(i))    -    x^t^-13)    ♦    [x1Ct^i))+x2(t^ib 
4-x3(t(13)+x4Ct(i))3At. 

This    step    is    similar   to    Step   6    of  the   unconstrained   algorithm, 

STEP    6a.       If   x-(t^)    <    0    or    x3(t^)    >    c*3 

put    A.(tW)    =    Xjt^3)*]!,    and   A1^    =    t^. 

This    step    is    required  to    assure    the    discontinuity    of   A~    at 

time   t'1'. 
5 

STEP  7,   Examine  the  value  of  H. 

4 
[  s  H  =  I       X  .  f  -  »  0  ? 

1  =  0  x  ;i 

If  "yes"  put  t,  =  t '■  "■  ,  D  =  xQ  and  go  to  Step  8. 
If  "no"  return  to  Step  2a. 


112 


STEP  8.    Check  the  state,  of  the  system  at  t,  . 
Is  the  final  state  reached? 

If  "yes,"  i.e.,  if-x-Ct,)  =  0    1  =  1,2,3,4  ■*  END.. 
If  "no"  assume  new  values  for  x.    i=l,2,3,4 
and  return  to  Steu  2. 

Steps  7  and  8  are  similar  to  Steps  7  and  8  of  the  uncon- 
strained algorithm,  with  the  only  difference  being  that  In 
Step  7  the  Hamiltonian  function  is  computed  from  Eq.  6.1.26. 

The  algorithm  satisfies  the  conditions  of  section  6.2 
since  (1]  A   remains  constant  during  the  period  at  which  the 

constraints  are  at  equality  (Step  3a),  (2)  the  jump  condition 

'"1 ) 
at  t^  -  is  met  (Step  6a),  and  (3)  the  optimal  controls  u*  and 

u*  in  the  interval  [tj   ,  ti   ]  are  determined  according  to 

the  procedures  developed  in  section  6,2.   When  constraints 

are  imposed  on  the  remaining  queues,  steps  similar  to  2a,  3a, 

5  a  ,  an d  6  a  m us  t  be  f  o  1 1  ow e d . 


CHAPTER    7 
EXTENSIONS    OF   THE    THEORY 


7.1.       Single    Overs aturated    Intersection 


Thus    far,    an    intersection    of   two   one-way   streets   was 
considered.       However,    the    theory    can   be    extended   to    an    inter- 
section   of   two   two-way   streets   where   more    than   two    approaches 
are    overs aturated    (assuming   two-phase    operation).       For 
example,    if   the    overs aturated   approaches    are    four,    the   prob- 
lem  is    formulated    as    follows: 

Problem:      Minimize    the    delay    function 


D   =    /      (x,+x9+x,  +  x,)dt  (7.1.1) 

o 

S  lib  j  C  C  t     to 

dx 

ar"  =  fi  =  Q-ru  C7.1.2) 

d  X  S 

-dlA  -    f2    =    VS2(1-c3  +  s7U  C7.1.33 

dx, 

^   -    f-   =    q,-u  (7.1.4) 


dt 


■  j 


ith    the   boundary    conditions 

x-  (0)    -    x,  (t,)    -    0  1-1,2,3,4  (7.1.6; 
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x0CO)    -    0    ,      x0(ta) 


free    to    vary 
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(7.1.7) 


u   is    an    admissible    control    in    the    interval 

(1) 


s    ^1) 
l^min 


c 


=    u    .       <    u   <    u 

mm    —        —     max 


S        <T 

2  "max 


(7.1.8) 


The    solution   proceeds    as    in    section    4.1,    I.e.,    by    defining 
the   Hamilton! an    function 


4 
H    =       E 
i  =  0 


(7.1.9) 


and  setting  3H/3u  =  0  to  find  the  optimal  control. 

If  the  final  time  is  fixed,  i.e.,  If  the  end  of  the  con- 
trol period  is  prescribed,  it  Is  evident  that  the  terminal 
control  problem  is  considered,   In  this  case,  the  Hamilton! an 
function  at  the  final  time  is  not  zero  and  the  algorithm  of 
section  4.3  .is  modified  as  follows. 


S T E PS  1  - 6  re m ain  un ch an g e d . 
STEP  7.    If  t(l] 


t,  go  to  Step  8, 


(i) 


If  tl-J  <  t      go  to  Step  3 


STEP    8.         Examine    the    state    of   the    system. 
Is    x1(t1)    -    0    and   x2(t1)    -    0? 
If    "yes"    and   H(t^)    =    H(t,3       END. 
If   "no"    or    if   H(t*-    ^  )    f    H(t,)    assume    new    values 
for  k,    and  k„    and   return    to   Step    3, 


"I 


"2 


If  the  Initial  conditions  are  different  from  zero,  the  only 
necessary  modification  would  be  to  sot  the  values  of  the  stat 
variables  at  time  zero  equal  to  the  specified  ones  (Step  2). 
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7.2.       Systems    of   Intersections 

The    theory    of   Chapter   6    can   be    extended   to    a   system   of 
more    than   two    consecutive    overs aturated   intersections    on    an 
arterial    street   such    as    the    ones    shown    in    Figure    7.1.      To 
formulate    the   problem,    the    following   definitions    are   necessary. 

M  =    the   number   of   intersections. 


d. 


=    -f-i^ 


the 


ime    delay    of   intersection    i    (i  =  l  ,2  , .  .  .  ,M)  , 
i.e.,    di    is    the    average    travel    time   between 
intersection    i    and  the    upstream  intersection. 

j    -    the    j         approach    to    an   intersection,    j=l,2. 

qi  j    =    the    demand   on    approach    i,j    (i=l  ,2  , .  .  .  ,M;    3  =  1,2) 


i»j) f„(i,i) 


lsnax"  '  )  -  the  minimum  (maximum)  green  time  on 


appro acn  i  fj 


sj_  -j  -  the  saturation  flow  on  approach  i,j. 

Ui  =  slsi   7'ci  =  the  control  variable  at  intersection  i 

i-1,2,.  .  .  ,M. 

ci  =  the  cycle  length  at  intersection  i  (i  =  l  ,2  ,  .  .  .  ,M)  . 


L 


a- 


i ,  1 


the  total  lost  time  at  intersection  i  (i=l ,2  , .  .  .  ,M)  . 
=  the  percentage  of  through  traffic  on  each  hori- 


:ontal  approach  i,l  (1=1,2 


2    -  the  percentage  of  vehicles  turning  right  on  each 


vertical  approach  i,2  (i=l ,2 , . . . ,M) 

the    out 
5=1,2). 


°j    a    -    tae    output    rate    on    approach    i,j     (i-1 ,2  ,. . .  ,M; 


j7\ 


2 


I 
1     r\ 


n.M/ 


Fi euro    7  . 1 
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It    is   noted   that   q.     .    is    a   given    function   if   approach 

i,j    is    an    external    approach    such    as    all    the    vertical    approaches 

and    approach    1,1.       If   i,j    is    an    internal    approach    such    as    all 

the    remaining  horizontal    approaches,    q.     .    is    given  by 

-*-  >  3 

b-1 


0'i,j(t)  =  ai-l,lui-lOdP  *   bi-l,2  Si-l.Z^-HT., 

V  1-1 

i "  1 , 2       ,,.   ,  J 

-s—rT^-l^Vj  C7.2.1) 


Furthermore,  the  output  rate  o.  -is 


u 


i  if   i,j    is    a  horizontal    approach      (7.2.2) 

L.  s  .    _ 

°i    i    =    s-;     ■  O--7— )    -    - — '—  u.         If    i   j    is'  a   vertical    link 
,J  ~'J  i  i,l      X  (7.2.5) 

The    problem    formulation    Is: 

Problem:   Minimize  the  delay  function 


t 


1   M    2 


D  =  f        *   ,2   (x    )dt  (7.2.4) 

o   1=1  j=l     ,J 


subject  to 

dx.  . 

fi,j  =  "^=  ai,J-°i,j       i-1.2,...,M,       (7.2.5) 

1  ■*■  ? « 

with    the   boundary    conditions 

xi     j  CO  3    =    X°  i  =  l,2,...  ,M;    j-1,2  (7.2.6) 

xj    iCtO    -    0  i=l-,2,...  ,M;    j=l,2  (7.2.7) 

and   the    admissible    control    domain 


S.V1'1-5  ,.,                       ...  s    CTCi,D 

J^iIL_  =  uCO    <    Ll.  <   ud)    =  Sl°max    _ 

c.  mm   —      1  —     max                c. 
J-                                                                            1 


(7.2.8) 
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The    solution   proceeds    as    in   Chapter   6,    that    is,   by 

defining    the    Harailtonian    function    as 

2 
Z 

i»l  j=l 

and  the  shifted  Hamiltonians 


M 

H  =  I         I       A .  .  f .  . 


(7.2.9) 


Hi  =  H(t)  +  H(t+d1)  + 


H(t+d.  .)    i=2,3,.,.,M 

(7.2.10) 


The  optimal  control  is  obtained  by  setting  dH/3u  and  3fT.  /3u 
equal  to  zero  in  the  appropriate  intervals.   Constraints  can 
also  be  imposed  on  the  queues  as  in  section  6.2. 


CHAPTER  8 
CONCLUSIONS  AND  RECOMMENDATIONS 

The  preceding  analyses  of  the  optimal  control  of  over- 
saturated  intersections  led  to  the  following  conclusions: 

1.  For  a  single  overs aturated  intersection  there 
exists  at  most  one  switch  point  if  no  con- 
straints are  placed  on  the  queues, 

2.  When  constraints  are  placed  on  the  queues 
several  switch  points  may  exist. 

5.   If  one  constraint  is  at  equality  the  cycle 
length  remains  constant;  however,  the  splits 
must  be  free  to  vary. 

4.  If  two  constraints  are  at  equality  simul- 
taneously, the  cycle  length  must  be  free  to 
vary. 

■ 

5.  In  the  special  case  where  the  demand  is  such 
that  the  intersection  operates  at  capacity 
during  the  time  interval  In  which  the  con- 
straints are  at  equality  simultaneously,  the 
cycle  length  is  constant. 

6.  The  optimum  cycle  length  is  the  maximum  allow- 
able cycle  length. 

7.  Bus  priorities  can  be  granted  without  affect- 
ing the  switch  point,  and  the  final  time. 

S.   For  a  system  of  two  or  more  overs  aturated 
intersections,  there  is  at  most  one  switch 
point  per  intersection,  assuming  that  no 
constraints  are  placed  on  the  queues. 

9,   If  constraints  are  placed  on  lengths  of  queues, 
conclusions  similar  to  the  ones  of  the  single 
intersection  are  valid. 

10.   For  a  system  of  two  or  more  consecutive  over- 
saturated  intersections ,  explicit  relationships 

1 1  S 
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between    the    control    variables    exist.       That    is, 
if    d   represents    the    average    travel    time    between 
two    intersections,    the    control    action    at    the 
downstream   intersection    is    a    function    of    the 
control    action    taken    at    the    upstream  inter- 
section   d  time    units    earlier. 

Since    the   work   performed   in    this    dissertation   is    pri- 
marily  theoretical,    it  presents    some   hypotheses    that    require 
further    discussion.       The    major    assumption    is    that    the    traffic 
voium.es    during   the    peak   period   are    predictable.      However,    the 
timing    of  pretimed   signals    is    based   on    the    implicit    assumption 
that    the    traffic   volumes    have    a   repetitive    and  predictable 
pactern.      Furthermore,    case    studies"    '        have    shown    that    the 
day-to-day    variability    in   peak   period   demand   is    relatively 
small    (approximately    1   percent).      Nonetheless,    if   the    day-to- 
day  variability    is    statistically   significant,    it    can  be    taken 
into   account   by   using   different   timing  plans    according   to   the 
day    of   the   week.       Tt   is    also  noted   that    accurate    prediction 
of   the    demand   is    not    crucial    since    the    optimal    control   strateg; 
results    in    less    total    delay    than    the    single    setting   strategy 
even   if   the    actual   volumes    are    substantially    different   than 
the    predicted   ones.      This    is    illustrated  by    an   example    in 
Appendix   A.       The    time    variation    of    the    demand   during    the    same 
peak    period   is    significant,    but    this    has    been    taken    into 
account   by    assuming   nonlinear    demand   curves. 

In    developing   the    theory,    the    implicit    assumption   was 
made    that    the    saturation    flow    is    constant    during    the    control 
period.      This,    however,    is    an    assumption    common    in   most    traf- 
fic  signal    control   strategies    and  has   been    found   to  be    Fairly 
real  is  ti  c. 
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If   real-time    (feedback)    control    is    to  be    considered,    the 
optimal    strategy  will    change    frequently,    based   on    information 
about    the    current    state    of    the    system   and    the    predicted   demand 
for   the    remaining   control   period.       For   this   purpose,   however, 
development    of   an    adaptive   prediction    algorithm  will  be   neces- 
sary.      Some    prediction    algorithms    have   been   proposed   in    Refer- 
ences   2    and  9.      Nonetheless,    these    algorithms   have   not  been 
used   in   practice,    mainly  because   they   oversimplify   real -world 
conditions.      Hence,    further   research   in   this    area   is   needed. 
Improved   traffic  prediction   models   will    also   benefit   existing 
real-time    signal    control    schemes. 

Extension    of   the    theory   to  multiphase    signals    is   not 
simple    and  should  be    the    subject    of   future    research.      The 
optimal    control    strategy    for  multiphase    oversaturated  signals 
will    certainly    become    more    complex    due    to    the    large    number   of 
control    variables    that    are    introduced. 

The   problems    considered   in    the   previous    chapters    can 
also   be    studied  with    stochastic    input.       It    should  be    pointed 
out,    however,    that    stochastic    optimal    control    is    a  new    field 
in    optimal    control    theory    and,    due    to    the    complexity    of   the 
problems,    complete    mathematical    analysis    may   not   be    feasible 
at    tins    time, 

Finally,    the    travel    times    (or    time    delays)    between    inter- 
sections   were    assumed    constant.       Although    this    assumption    is 
practically    realistic,    the    optimal    signal    control,   problem 
with    time- varying    delays    should  be    considered.      At    this    time, 
however,    optimal    control   with    time- varying    delays    is    a   problem 
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that  "has  not  been  solved  theoretically  and  further  research 
in  this  area  is  needed. 


APPENDIX   A 
APPLICATIONS    OF   THE    THEORY 

A .  1 .       Introduction 

So    far,    the   mathematics    for   achieving    the    optimal    con- 
trol   of   overs  at ur ate d   intersections   were    developed    (Chapters 
4-7).      Using   the    results    of   the   preceding   theory    one    can    find 
the    optimal    control   policy    for   a  particular   situation.      Then 
the    optimal   solution    can  be    compared  with   sub-optimal   policies 
which   may    require    less    control    effort.       Based   on    engineering 
considerations    and   judgment,    a   decision    can  be   made    as    to 
whether   or  not.   the    optimal   policy   should  be    followed   for   the 
particular  problem.      As    in   most    optimization   problems,    it   is 
not  necessary    for   the    optimal   solution    to  be    always   highly 
beneficial   when   it   is    compared  with   suboptimal   solutions. 
It   should  be    remembered   that    the    optimal   solution    does   not 
always    imply  bang-bang    control;    therefore    switch  points    may 
not    exist. 

For   purposes    of    illustration    of   the    theory,    some    typical 
examples    are   presented   in   the    following   sections.      For   each 
example    a    computer   program   utilizing    the    appropriate    algo- 
rithms   (Chapters    4-7)    was    developed.      The    algorithms    incor- 
porate   the    use    of    an    optimization    routine.       This    routine    is 
based   on    a    searching  method  to   determine    the   minimum  of   a 
function    of  N   independent    variables. 
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In    searching,    one    is    interested   in    finding   the    set    of 
values    of   the    independent   variables   which   yield   the    extremum 
(i.e.,    maximum   or  minimum)    value    for  the    dependent    function. 
A   set    of   values    for   the    dependent   variables    is    referred   to    as 
a    location,    and  hence    the    general   problem    can   be    stated    as 
finding   the    location    at  which    the    function    takes    on    its 
e  xt  re  mum   value . 

Consider   the    case    in  which   the    initial    location   is    given 
or   selected   at    random,      A  new    location    is    to  be    selected. 
There    are    two   general   qiiestions    about   the    selection    of   the 
new    location.       One    is    the    direction    of   the   new    location    rela- 
tive   to   the    old   location,    and   the    second   is    the    distance 
between    the    locations.      There    are    several   searching   strategies 
to   resolve    these    two  problems.       In    the    sectioning   procedure 
one   moves    in    a   direction  which    is    parallel   to   one    of   the 
coordinates;    one    independent   variable    is    changed   at    a  time. 
In    the    steepest    ascent    technique    one   moves    in   the    direction 
of   the    gradient    of   the    function.       In  both    of   these    techniques 
one    can   either  move    for   an    arbitrarily   specified   distance    or 
one    can   move    in   the    same    direction    as    long   as    the    value    of   the 
function    is    increasing    (assuming    that    it    is    desired   to   maxi- 
mize   the    function).       A   new    direction    is    then    determined    at 
the    location    of   this    local    maximum. 

Symbolically,    the    general    search   problem   can   be    stated 
as    follows  : 

Max:       J    -    f(X(i  +  1))    -    f  (X^  +  a(i)  -p  Ci)  ) 


1 2  4 


subject    to  Xv    7       as    given 

p      "       as    determined  by    a  particular   method 

where   X^    ;    =    the    i  Lj     location 

— (i)         *.!.       -th    j. 

pv    ■*    =    the    i        direction 

a  =    a  scaler   indicating   distance    moved. 
Once    the    direction  has   been   chosen,    the   problem   of   locat- 
ing  a   distance    at  which    a   relative   maximum   occurs    is    the    same 
problem   as    searching   for   the   maximum   of   a   function   of   one 
variable.       In    this    case    the    variable    is    a^      .       If   one  were 
able    to    choose    the    interval    of   interest    and  willing   to   make 

the    assumption   that    the    function  was    unimodal,    then   one    could 

31 
use    the    Fibonacci    search   technique    '    to   solve    the   problem.      Of 

course,    there    Is   no   need   for   determining   the    location   of   these 

restricted  maxima   very    accurately    since    they  may  be    a  long  way 

from   the    maximum  value    of   the    function.       In    fact,    one    is 

forced   to   make    a   choice   between   the    time    spent   searching    for 

the    restricted  maxima   and  the    time    spent    in   establishing    a  new 

direction,      A  search   procedure    can  be    described  by   stating  how 

the    direction    vector  p    is    determined.       The    search   methods    can 

be    classified  by  whether   they   employ   knowledge    of   the    first 

and  second   derivatives    in   determining  p". 


Th< 


re    are    several    interesting   points    that    could   be    men- 


tioned   about    the    searching   techniques    and   the    interested 
reader    is    referred   to    References    31,    32,    and    33    for   more 
details,    sln.ce    detailed    discussion    on    this    subject    is    beyond 
the    scope    of   this    section. 
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The    optimization    routine    incorporated   in   the    computer 
programs    is    based   on    a   searching   method   developed  by   Powell. 
Powell   has    shown    that   quadratic    functions    (such    as    the    ones 
incorporated   in   the    algorithms)    result    in   faster   convergence. 
According   to   this   method,    N   direction   vectors    (p.)    are    set    up 
for   a   function    of  N   variables.       On    the    first   iteration   they 
correspond   to    the    coordinate    directions.      After  N    steps,    a 
new    direction   X  T-X„    is    added   to   the    set.      Then  p.    is    discarded 
and  p.+,    is    stored   in   p.     (i  =  l  ,2  ,  . . .  ,N) .      Thus,    the    extrapola- 
tion   direction   is    remembered   and  incorporated   into   the    search. 
After  N    such    iterations,    all    the    original    direction    vectors 
have   been    replaced.      Evaluation    of   the    derivatives    is   not 
necessary    and  this    is    one    of  the    reasons    justifying   the    selec- 
tion   of   the   subroutine.       Reference    32    suggests    that   Powell's 
method   is    the   most   effective    for    cases   where    the    objective 
function    is    a  nonexplicit    function   of   the    independent   vari- 
ables.     The    routine    (called   RMINSQ*)    computes    the    values    of  N 
parameters    that   minimize    the    sum   of  squares    of  M   functions. 

Input    to    the    computer  programs    are    typical   traffic  param- 
eters   such    as    maximum   and  minimum   allowable    green   intervals, 
saturation    flows,    cycle    lengths,    number   of   lanes    for   each 
approach,    input    volumes    per    lane    in    a   tabular    form,    etc,      The 
output    of  the   programs    are,    in   general,    switch  points    (if   any), 
final    times,    total    delays,    and   all    the    necessary    information 
that    constitutes    the    optimal    control    policy. 


*RM1NSQ    is    a   standard   scientific   subroutine    available    at 
the    Northeast    Regional    Data    Center   of   the    State    University 


Sys  tern  o  t    Florida 


A . 2 .  '  The  Unconstraine d  Problem 

In  this  problem  the  objective  of  the  control  is  to  bring 
the  state  of  the  system  to  the  origin  in  minimum  time.   Alter- 
nately stated,  assuming  that  at  time  t  =  0  the  queue  lengths 
are  zero  on  both  approaches,  one   wishes  to  find  the  optimal 
control  that  ends  the  overs aturation  period  as  soon  as  pos- 
sible and  minimizes  the  aggregate  delay.   The  queues  are  not 
allowed  to  become  negative  during  the  control  period. 

Consider  an  intersection  for  which  the  following  infor- 
mation is  given  for  the  two  conflicting  streams: 

Approach  1:   Saturation  flow:   s,  =  1400  vPhg  =  .388  veh/sec 

N unib e r  of  1  an e s  :   2 

Lost    time:       1      =    3   sec/cycle 

Minimum   green   time:      G>min-'    =    50    seconds 

Input    volumes    (per   lane):       5-minute    counts    as 

presented   in   Table   A-l. 

Approach    2:       Saturation    flow:       s      =    1000    vphg   -    .2  78   veh/sec 

Numb e r   of   1  ane s  :       1 

Lost    time:       1?    =    3   sec/cycle 

Minimum    green    time:       G)min^    =    40    seconds 

Input    volumes:       5-minute    counts    as    presented   in 

T  ab  1  e    A  - 1 . 

The  cycle  length  is  assumed  equal  to  150  seconds  and  At  equal 
to  2  seconds. 

The  solution,  is  given  by  a  computer  program  which  utilizes 
the  algorithm  developed  in  section  4.2.  The  output  of  the  pro- 
gram is  shown  In  Table  A-2.   The  first  column  of  the  table 
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Table   A-l 


INPUT     VOLUMES/LANE 

£  5jc    it  ■=*   ^  -*   ^  A;     ,t  .TJC  *r    £  ^  3X  ;*   £  ~  ^  ^c  ^    £   ,*;  *y   ^ 

*     APP«I     *     APP.2     *     TIM"     * 
drj£  *  jjs  *  jSt  •£:*  iofc  x  A  sn  *ifc  *  %  -jt  jj!  A414.  A  5$: 


Q.» 

Q» 

0» 

121  • 

£6  O 

30  0  . 

2CS* 

147, 

5  0  0  » 

2  63a 

90  Oo 

3  i  8  * 

2  27  3 

1  2  0  0  * 

0  0  v  0 

257, 

15  3  0* 

3  96  a 

283, 

1300, 

430  9 

3C7„ 

2  1  0  0  » 

4fc2*, 

330* 

24003 

492* 

3=2, 

2  7  0  0  » 

523, 

373* 

3  0  0  0  » 

552* 

394, 

33  00, 

5  8  2, 

4-1  5  » 

3  600a 

6  i  J  , 

436. 

3  9  0  0, 

c4C» 

457* 

4200* 

indicates  the  iterations  performed  by  the  program.   The 
second  and  third  columns  give  the  final  time  and  the  switch 
points  which  are  obtained  if  k,  and  k~  (the  integration  con- 
stants of  Eqs.  4.1.48  and  4.1.49)  are  specified  as  shown  in 
columns  4  and  5.   According  to  the  algorithm,  in  every  itera- 
tion the  new  values  of  k,  and  k?  are  determined  by  the  optimi- 
zation routine  based  on  the  value  of  the  objective  function 
which  is  shown  in  column  5.   The  objective  function  is  equal 
to  the  sum  of  squares  of  the  queue  lengths  at  the  final  time. 
The  last  two  columns  give  the  value  of  the  Hamiltonian  func- 
tion H  at  the  final  time  and  the  total  delays,  respectively. 
Finally,  the  optimum  values  of  k-,  and  k?  that  minimize  the 
objective  function  are  given  by  the  optimization  routine 
RMINSQ  and  arc  shown  below  the  table.   Using  these  optimum 
values,  one  can  go  back  to  the  table  to  find  the  optimal  solu- 
tion.  It  must  be  pointed  out  that  the  optimal  solution  is 
not  necessarily  given  in  the  last  iteration  since  the 
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Table   A- 2 


IT  E  P 

AT  IONS 

tt  ■&  A  -.v 

jjs  x  -^  sc  ^c  ■« 

%  ^  -a;  -wr  ^c  is 

&  ^r  jjs  ^:  $s  i;  ^  ?L'  :.V  :a;  -x  r?  ak  xc  ^  -s  -i;  ^< 

ix  $z  ix  ifi,  ~>.  $t  ip  -£ 

^e^;^  4cfei< 

^:^k^t^:M^^c~jzi: 

*     I 

*     Tl 

*     TAU 

*          Kl        *          K2        * 

OBJ  a      * 

H             * 

DELAY        * 

*  *  A  ^ 

**»*st 

£:  jjc  -J;  i  >c  -i: 

te  J:  £  *  ^(  ;rc  ;&  36    la  A  ^  -^  ^s  «  3k  ^   W  ^ 
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optimization    routine   performs    various    tests    to   ensure    as   much 
as    possible    that    the    global    minimum  has    been    reached. 

From   the    computer   printout    (Table   A-2,    bottom)    it    is 
seen    that    the    optimum   values    of  k.     and  k.      are    -2  241.9  8    and 
-2741.32,    respectively;    from   Table    A-2    one    can   verify    that 
these    values    are    obtained    after    55    iterations.       On    the    55th 
iteration   it    is    observed   that   the    switchover   time    is    994 
seconds    and   the    final    time    2558   seconds;    thus    the   optimal 
control   policy   is    to   give   maximum   green   time    to   the    first 
approach     (therefore    minimum   green    time    to    the    second    approach) 
from  the   beginning   of   the    oversaturation  period   until    time 
T    =    994    seconds;    after    this    time    minimum   green   should  be 
given   to    the    first    approach    and  maximum  to   the    second.      The 
total    delays    that    result    from   this    strategy    are    97.8    vehicle 
hours.       However,    one    may    choose    not    to    follow    the    optimal 
policy    and   impose    the    single    setting   strategy.      The    single 
setting   that   ends    the    oversaturation   period   at   time    2558    can 
be    computed   from  the    slopes    of   the    output    curves    as    follows: 

ul    =    slo?e    of   output    curve    of   approach    1   =    constant 
a    .total    output    in    time    2  55  8         4  7  7* 


2  55  8  2T58" 


0.1865 


and   since 


3lgl 


"1  c 

follows    that 

*Froin  Table   A-l 
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(0.186  5) -150 
0  .  5  8  S 


72    seconds 


or 


G,    =    72    sec   +    3   sec    (  =    lost    time)    ='   75    sec   =    0.50*c 

therefore,    G?    =    (l-O.SO)-c   =    0.50-c.       The    total    delay  can  be 

computed   in    a   manner   similar    to    the   bang-bang    control  (i.e., 

the    area  between   the    input-output    curves).      The    total  delay- 
resulting    from  the    single    setting   strategy    is    also   shown 

below   Table    A-2    and   is    equal    to    123.3    vehicle   hours.  Thus, 

the    delay    saved   to    the    drivers    is    123.3    -    97.8    =    25.3  vehicle 

hours.       This    means    that    the    average    delay   per   vehicle  is 
reduced  by    the    amount 


25. 


2(477)    +    341 


71.0    second; 


It    is    therefore    concluded   that   the   bang-bang   control    is   highly 
bene  ficial . 


A. 3.       The    Optimal    Cycle    Length 

The   problem   of   finding    the    optimal    cycle    length  was    dis- 
cussed  in   section    4.6,   where    it  was    concluded  that   the    opti- 
mum  cycle    length   is    the    maximum   allowable    cycle    length,    a  pro^ 
ce  dure    already    used   in   practice. 

In    this    section    a  numerical    example    is    given    to    demon- 
strate   this    point.       The    input    volumes,    the    saturation    flows, 
and    the    remaining    traffic   parameters    are    the    same    as    in    the 
previous    example.       In    addition,    the    upper    and   lower  bounds 
■placed    on    the    cycle    lencth    are    assumed    to    be    100    and    1000 
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seconds ,  respectively.   A  cycle  length  o£  1000  seconds  is, 
of  course,  too  high  to  be  practical  but  is  used  here  only  for 
illustrative  purposes. 

The  total  delay,  the  switchover  time  and  the  final  time 
were  computed  for  cycle  lengths  of  100,  200,  .  ..,  1000  seconds 
and  the  results  are  illustrated  in  Figures  A. 1  and  A. 2 .   The 
effect  of  the  cycle  length  on  the  total  delay  is  shown  in 
Figure  A.l.   As  can  be  seen  from  this  figure,  the  total  delay 
falls  sharply  when  the  cycle  length  is  between  10  0  and  30  0 
seconds.   For  cycle  lengths  greater  than  300  seconds,  the 
delay  savings  are  relatively  small. 

Figure  A. 2  shows  the  effect  of  cycle  length  on  final  time 
and  switchover  time.   The  dashed  line  in  this  figure  shows  the 
effect  of  cycle  length  on  final  time,  whereas  the  solid  line 
shows  the  effect  on  switchover  time.   Final  time  decreases 
with  increasing  cycle  length,  as  expected. 

Cycle  length  also  affects  switchover  time  because  of  the 
change  of  the  maximum  output  rates  on  each  approach.   That 
is,  the  maximum  output  rates  (as  defined  in  section  4.1) 
increase  with  increasing  cycle  length.   In  Chapter  4  it  'was 
shown  that  the  switchover  time  is  either  the  time  x  at  which 
the  z  function  (defined  also  in  section  4.1)  becomes  zero  or 
the  time  t^"J  at  which  the  maximum  cumulative  output  curve 
of  the  first  approach  intersects  the  demand  curve.   If  x  is 
greater  than  t  -  -    the  switchover  time  is  t^^J   ,  so  that  no 
negative  queues  are  allowed.   The  intersection  of  these  two 
switchover  time  functions  produces  the  peak  at  c  =  200  in 
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Figure  A. 2.   When  c  equals  100  seconds,  x  Is  less  than  t ^   , 
i.e.,  the  switchover  point  lies  below  the  cumulative  demand 
curve.   When  c  is  greater  than  or  equal  to  200  seconds,  t  is 
greater  than  t^^J    and  the  switchover  point  is  the  point  of 
intersection  of  the  input- output  curves. 

A . 4 .   The  Fixed  Final  Time  Problem 

In  this  problem  it  is  assumed  that  the  final  time  is  not 
free  to  vary  but  it  is  fixed.   The  objective  of  the  control 
is  to  bring  the  state  of  the  system  as  close  as  possible  to 
the  origin  (zero  state)  at  a  given  time  t-,  .   Suppose  that  in 
the  example  of  section  4.2  the  final  time  t,  is  equal  to  2100 
seconds.   The  question  arises  then  as  to  how  the  control  is 
affected  by  this  objective.   Alternately  stated,  it  Is  of 
interest  to  know  if  a  switch  point  still  exists,  and  If  it  is 
the  same  as  in  the  free  final  time  problem.   The  appropriate 
algorithm  for  the  solution  of  this  problem,  as  given  in  sec- 
tion 7.1,  is  incorporated  in  a  computer  program  that  generated 
the  output  of  Table  A- 3.. 

Inputs  to  the  program  are  the  same  as  in  the  previous 
example,  the  only  difference  being  that  t,  is  equal  to  2100 
seconds.   The  output  of  the  program  is  Interpreted  in  a  simi- 
lar manner  as  before.   It  must  be  pointed  out  that  since  the 
final  time  is  net  free,  the  Hamilton! an  function  does  not 
have  to  be  zero.   The  optimal  solution  Is  obtained  in  the 
14th  iteration  for  k   =  -260  3.78  and  k,  -  -3256.82.   The  new 
switchover  time  is  9  70  seconds  and  the  total  delays 
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Table    A- 3 

T  £  r.  A  T  I  C  N  S 

«     I     *     Tl         *  TAU  *  Ki         *  K2        *  QQJ*     *        H        *        DELAY        * 

:*Ji«A*aa-ti*-Siis*x^3aiA*i?--i*a:^    ■$:  *  ,ft  ■%  3?  if  if  <8  -Jf  *  4>  ^  *•  **  5ft*  5K  ♦  ♦  w  ^  *  *  ^  *  *  ♦  ~ 

1  2100,  502*  -2569»78-3236»97  44,33  49,17        S5<,8 

2  2100,  893»  -2568.78-3236,97  44a42  49302 
2        2X00*  9C4,  -2569* 78-3235*97  44,29  49,15 

4  2100,  333*  -2572.25-3241,97  44„42  49* 57 

5  2'iGO,  9G4*  -2567. 27-3231*97  44,29  43,72 
o  21C^  9C6*  -2365.2  2-3  229*39  44*25  4  8,56 
7  210  3*  Si  4,  -2  551  *  20-  32  19.,  39  44*10  4-7,7  7 
a  2100*  924,  -2553*74-32  35,0  2  43«94  46*53 
9   2100*  940=,  -2543.70-3165902  43,75  44,94 

10   21003  9384  -2539*51-3180.02  43,77  44*32 

13.   2100*  942,  -2547^88-3  190*02  43,73  45=57 

12  2100,  946a  -2556.,  25-3200*02  435.70  46*82 

13  2100s  954-,  ~2572i93-3220.,02  43,65  49,33 

14  2103=,  970*  -2603*73-3256.32  43,61  53*99 

15  .    2100*  970a  -2607,37-3261*32  43*61  54,54 
1c        2100.,  970,  -26143  56-3271  ,8  2  43*61  55*64 

17  2100*  970,  -2623*93-3291,82  43*61  57,83 

18  2100*  972=,  -2657*66-3331*32  43*61  62*29 

19  2100*  970,  -2549»90-3181»82  43*61  45*74 

20  2100a  970*  -2576, 84-3219*32  43,61  49,87 
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accumulated   until   t-,    =    210  0    seconds    are    9  3,0    vehicle   hours. 
Therefore,    it    is    concluded   that    the    switchover   time   with 
fixed   final    time    is,    in   general,    different    than   the    switch- 
over  time    corresponding   to   the    free    final   time   problem. 

A.  5 .       The    Constrained   Problem 

The    optimal   solution   of   section  A. 2   minimizes    the    aggrs 
gate    delay    subject    to    lower  bound   constraints,    but    it    does 
nor    take    into    account    the    maximum  queues    that    develop    on    the 
two    approaches.       In    fact,    if   the    demand   curves    have    the 
general    shape    of    Figure    A. 3,    the   bang-bang    control    results 
in    lower   maximum   queue    length    on    approach    1    and  higher   on 
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Figure  A. 3 


approach  2  than  the  single  setting  control.   This  can  be 
visualized  by  inspection  of  the  figure.   The  output  curve  OAB 
results  in  lower  queues  on  approach  1  than  does  the  output 
curve  OB,       Conversely,  on  approach  2  the  output  curve  OA'B' 
results  in  higher  queues  than  does  the  output  curve  OB'. 
Thus,  in  general,  it  is  the  second  approach  that  suffers  if 
no  constraints  are  placed  on  the  queues. 
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Using    the    results    of   section   A. 2,    one    can    easily   verify 
(by  plotting   the    input-output    curves    or  by  numerical   integra- 
tion)   that    the    maximum   queue    length    on    approach    2    with    single 
setting    is    approximately    80    vehicles.       If   the   bang-bang    con- 
trol   is    imposed   the    maximum   queue    on    the    same    approach    occurs 
at   time    x    =    994    and   it    is    equal    to 

X2  =  Q2(t)  -  G?(x)  =  204  -  {[(0.35)150-3]  (0.278)/150) 
•  994  =  204  -  91  =  113  vehicles 

Hence,    the    maximum  queue    on   this    approach    increases    substan- 
tially with    the   bang-bang   control,    and   it    is    desirable    to 
impose    constraints. 

In    this    example    it    is    assumed  that   the    second   queue    is 
constrained   so    that    it    does    not    exceed   the    limit    of    80 
vehicles.       The    results    (following  the    theory    and.  the    algorithm 
of   sections    4,2    and   4.4)    are    summarized  in   Table   A.  4.      The 
optimal    solution    is    obtained   on    the    21st   iteration    for  k.,    = 
-2361.48    and  k?    =    -2651.99.      The    optimal    control    strategy 
is    as    follows: 

1.  From   t    =    0    to    t   =    47  8 ,    u*    =    u 

'  max 

2.  At  t  =  4  78  (switch  1)  the  queue  on  the  second 
approach  is  80  vehicles  and  u*  takes  the  value 
Of  0.191. 

3.  At  t  =  15  0  2  (switch  2)  the  queue  on  the  second 
approach  is  less  than  SO  vehicles  and  at  this 
time  u"  becomes  maximum  again. 

4.  The  average  value  of  u*  in  the  interval  [478, 
1502]  is  .191. 

5.  At  t  =  16  36;,  u*  is  switched  From  maximum  to 
minimum. 


137 


Table   A- 4 
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The    trajectory   of  u   is    illustrated   in   Figure   A, 4.      The 
total    delay  with    this    control   is    100,9    vehicle   hours,   which 
is    still    substantially    less    than   the   single    setting    control 
From   this    example    it    is    seen    that    the    control    effort    in- 
creases   as    the    performance    requirements    increase,    as    expect* 
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A . 6 .   Se n s itivity  An aly s is 

The  demand  volumes  are  input  parameters  that  are  assumed 


to  he  known  for  a  particular  intersection.   In 


the 


timing  of  pretimed  signals  is  based  on  the  implicit  assumption 
that  traffic  volumes  are  repetitive  and  predictable.  The  pre- 
dictability of  traffic  is  generally  recognized  as  a  fact,  and 

29  30 
previous  studies   '    have  shown  that  hourly  volume  variations 

for  urban  streets  are  fairly  consistent.   As  an  example,  a 

report  on  the  traffic,  counting  program  in  Cincinnati  '  showed 

a  variation  of  less  than  1  percent  during  the  peak  periods 

-within  a  year. 

The  total  delay  (objective  function)  changes  if  the 

demand  volumes  (input  parameters )  are  other  than  the  predicted 

ones;  however,  the  control  action  will  remain  the  same  when 

the  signal  operates  on  the  pretimed  node  (open  loop  control). 

the  one  that  corresponds. 
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to  the  estimated  demand  volumes.   Based  on  actual  counts, 
one  can  determine  the  daily  variation  of  the  demand  volumes 
and  study  the  effect  on  the  total  delays.   Although  the  day- 
to-day  variability  is  expected  to  be  small,  the  variability 
within  the  peak  period  is  significant;""  '    however,  it  has 
been  taken  into  account  by  assuming  nonlinear  demand  curves. 
This  is  indeed  one  of  the  advantages  of  the  previously 
developed  th  e  o  r y  . 

It  will  now  be  assumed  that  the  volumes  at  the  inter- 
section considered  in  section  A. 2  can  either  increase  or 
decrease  by  at  most  10  percent.   The  total  delay  resulting 
from  the  two  types  of  control  (single  or  double  setting)  and 
the  three  volume  conditions  are  calculated  and  summarized  in 
Table  A-5.   The  delay  units  are  in  vehicle  hours. 

Table  A-5 


^\Volumes 
St  rat  e  gy^-v. 

-10% 

Predicted 

+  10% 

Single 
setting 

Doub  le 
setting 

74.1 
5  7.0 

12  3.3 

9  7.8 

19  3.1 

175.9 

From  the  tabic  it  is  seen  that  when  the  volumes  increase 
by  10  percent  the  total  delay  corresponding  to  the  double 
sotting  strategy  increases  by  nearly  80  percent,  whereas  the 
delay  with  single  setting  increases  only  by  56  percent.   The 
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double  setting  strategy,  however,  still  results  in  lower  total 
delay  than  does  the  single  setting  strategy. 

When  the  volumes  decrease  by  10  percent,  the  total  delay 
corresponding  to  the  double  setting  strategy  decreases  by  42 
percent  while  the  decrease  with  the  single  setting  strategy 
is  40  percent.   Again,  the  double  setting  strategy  results  in 
less  total  de 1 ay . 

The  results  are  illustrated  in  Figure  A. 5  in  which  the 
total  delay  is  plotted  as  a  function  of  the  volumes  and  the 
two  control  strategies.   Clearly,  the  two  curves  do  not  cross 
over,   Hence,  it  is  concluded  that  the  optimal  control  strat- 
egy results  in  less  total  delay  than  does  the  single  setting 
strategy  even  in  the  case  where  the  actual  volumes  are  sub- 
stantially different  than  the  estimated  ones.   This  conclusion 
is  important  since  it  suggests  that  the  developed  theory  is 
applicable  in  situations  where  accurate  prediction  of  the 
demand  is  not  possible. 

200- 


1S0-L 


(3*  10  0 


2  so- 


—  — .  Single  setting 
Double  setting 


10% 


+  101 


Volumes 
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